Radio plays when not turned on

I scanned the radio problems and did not find mine - sorry if I missed it.
My 1996 Grand Caravan can pick up radio signals even when turned off. When this happens I have no control over the station, volume, etc. since the radio is turned off. Even if I turn it on, I have no control. I have listened to Spanish, rock, even football play-by-play. Cannot turn it off.
The reason my radio is turned off is that it quit working. Still does not work when I want it to. Just suddenly starts playing on random stations. I do not know if it would do this with engine off since I am not in the car without engine running. All other systems seem to be functioning correctly (minor miracle in itself).

I bought the high-end Infinity-10 Premium Sound System (AM/FM/Cassette/CD) with my Caravan incorrectly thinking that better means better. Three years later, the CD head unit was dead - all I get now is Err on the display panel when I insert a CD.

I tried cleaners, everything. Nothing short of a replacement unit would do.

I absolutely refuse to put another non-essential penny into my Caravan. If and when I choose to get the stereo fixed, I'll replace the whole bloody thing with an Alpine. It burns my muffins to pay money TWICE for something I think should last for years.

I've had this broken A/C Delco CD Player in my Caravan for five, nearly six years running. I got one of those cassette/CD thingees that you insert into the tape deck at one end and plug into a portable CD player at the other. Works fine for those times I have to play a CD.

Try pulling ALL power from the radio for at least a few minutes- I would remove it from the dash and unplug it to insure it was completely unplugged-this might clear up any microprocessor lock up you might have.