Emergency Brake Cable

I've taken my rear caliper off my of 96 firebird and I'm try to get the cable unhooked from the lever on the caliper that adjust the piston. Is it suppose to move freely because I can't pull the cable off of the lever because of the way its possition, the lever its attached to want budge, is it suppose to be that way? If so can anyone explain how I'm suppose to release it? Any help would be apprecaited.