97 Grand Prix Door Chime

I have a 97 Grand Prix SE. I just installed an aftermarket CD player in it. I got it all wired up using the adapters I bought, tested it (it worked fine) and while putting the dashboard back together the door chime started to ring. The key wasn't in the ignition. If I close the driver's side door the chime stops. When I start the car, you can open the drivers door and chime will not ring. I checked all the fuses and everything looks fine. Does anyone have any ideas what might be causing this and how do I fix it?