99 Burb Ext. Handle Broke

99 Burb with ext. driver handle falling off. Still operates mechnisim. Do I have to remove the interior panel to fix/replace or can I just lossen bolt on jam of door & do it like that? Is the front of the handle just push into a hole with a plastic rivit type of thing or is it actually a screw that needs to be attached. Thanks in advance.