Automatic Door Lock Cover Panel

I have a 97 Voyager. I need to install a new switch for the automatic door lock on the driver's side door. There is a small panel (surrounding the door handle) which houses the power-lock switch.

I have removed the three screws holding it in, but still it won't come out. I don't want to damage this panel, so I would appreciate any advice on removing it before I screw it up and break something.

Thanks
Rich