Leather Seats-seat covers

I'm trying to put on the factory neoprene seat covers. I can't get the head rests off. Does anyone have this problem? I know how to take them off...they came off fine on the cloth charcoal seats. Is this a "leather" issue?