Voltage drop at a stop light is normal. If your idle is low from a bad IAC that will make the voltage drop more prevalent.
If the pulley truly is seized though I would get it replaced. It could burn the belt up which in turn could cause it to shred, which could wrap around the crank pulley and make the car jump time. I have seen it happen more than once.