starter clicking sound

I have a 95 Skylark and recently replaced the starter. It has worked like a charm. However, recently the starter makes a loud clicking sound when starting the engine and stops when the starter stops. The engine starts fine, but the clicking sound doesn't sound normal.

Does anyone know what is happening?