coverting hard top to a soft top

If I switch my hard top to a soft top, during the summer months, will this mess up my hard top when I put it back on for the winter? Will the hard top seal OK with the soft top hardware on it, or do I have to take all the hardware off for the hard top?