It's definitely overcharging, as you suspect. The regulator is in the alternator, so you need a new or rebuilt alternator, or get a new regulator and install it yourself. Rockauto.com sells them for about $30 plus shipping.
Don't drive the car, not even for a little bit, until you get this done. An overcharged battery is hazardous.