what more to pull center console?

My '09 SE 2dr 5spd would be more comfortable if bent the hand brake back to the middle. I removed 2 screws ea. side of the console and push plugs near heater but It seems the dash holds the console from being pulled straight back. How much more disassembly to get that blasted console out?