How to remove Caravan rear hatch handle?

I have some rust aroung the exterior handle of my 1999 Grand Caravan and want to paint the hatch. I want to remove the exterior handle to do a good job. I removed the interior liner, thinking that I could unbolt the handle but I can't see any way to do it. There's only a white plastic "bolt" with a hexagon head that appears to hold the handle to the door but I can't get it to turn. Is this what holds the handle to the door? Any suggestions appreciated.