Sounds like the synchros are shot, I believe that the 1-3-5 are linked together, but I am not certain. I remember I had a cavalier that did the same thing and it was the synchros. It was under warranty so don't ask me how to fix it!!!
I know the front-wheel drive cavalier and the rwd pickups are different machines, so again I'm not sure.