After replacing battery car makes a loud click while trying to crank. Eventually it might start. Recently it sounds like a loud noise coming from the starter also. Any ideas, do I need to replace contacts or whole starter?

Thanks

Probably, you just need contacts.

If the click sound is a clunk, and / or the starter is making a high pitched noise, or w whirrr sound like it's spinning fast, you've ground teeth off the flywheel/flexplate (depending on M/T, or A/T) & the starter can't grab the teeth to turn the engine over.
Otherwise clicking is a sign of too little electricity. Be that a dead battery, or corroded battery terminals. FYI never say a terminal is not corroded until it is taken off & cleaned.