replacing RH side manual mirror on 2DR

My wife clipped an orange barrel on the freeway and broke her RH side mirror on her 2DR. I bought a mirror and I'm going to replace it. The inside cover is my issue and I don't want to pull on it to access the bolts and potentially break any tabs and ruining the inside cover. Anyone have any info if it's ok to pry it off, slide it, remove the door panel? Thanks.