fuel pump relay clicking

I own a 96 Jetta 2.0 litre automatic. I recently had starter trouble, replaced it and car starts fine. But immediately after replacing and starting for the first time the fuel pump relay now clicks repeatedly with the key in the on position, then stops once the car starts. After starting, the car runs and drives fine. I replaced the relay with a new one and it still clicks. I also cleaned all connection to and from starter, including ground. Any suggestions would be greatly appreciated. Thanks.

The clicking may not be coming from the fp relay. There is a warning buzzer relay-looking thing plugged into the fuse block with the relays. It's taller than most and has a speaker-type top on it. When the e-brake is up or something it will chatter instead of buzz or beep because it's probably going bad. You can try pulling it out completely and see if the noise goes away. Hope that's the problem. If not, look down stream on the wiring that goes into the fuel pump relay and see if there's not a diode or fusible link that might be acting up.