I don't believe so. That shaft simply sits in the white part and turns the switch. I replaced mine when I replaced my tranny and I didn't have similar problems. You have nothing to worry about. (although since you're dismantling an electrical switch, it may be wise to disconnect your battery until you have it out.)
Mark