I managed to get the switch panel out, but I broke the front clip. The rear of the panel was exactly the same as the image you posted, but the front is not the L shape as shown in the diagram. On mine the front also lifts straight out, so when I tried to pull it back it snapped. It's a straight up and down plastic tab with a metal clip attached. I figured it was just very tight like the rear clip. Typical Ford to have several versions of every single part.
The problem with this is, if you have the L bracket and you pry straight up you will break it, and if you have my style and pull back you will break it, so you have to guess right. I guess the trick is, once you pry the back off, you have to peek up front to see which style front tab you have.
Here's a photo of mine just in case anyone else has this problem. I just rested the front tab where it used to be for the photo.