2001 GMC Jimmy Bose speakers rattling door panels

have a 2001 GMC Jimmy with the Bose sound system. There are speakers in both of the front doors right by where your ankle would be and with normal volume and bass levels, the speakers rattle the door panel and it's very annoying. I looked at where the plastic panel meets the metal of the door and there's a space about the thickness of a nickel inbetween them. I have small objects jammed in that space just as a quick fix (i can remove them if I want to) but I need to know if the door panel needs to be readjusted or what I should do as a long term solution.

alot of the times the white clips that hold the door panel to the door itself wear out and kinda stretch. check them before anything else. this could very well be your problem. if so replace with new ones.

Ok thanks very much, I'll check that out

Also if I remove the panel from the door, what's the best way to do that without damaging anything? Is there a trick to it or more of a trial and error sort of thing?