I wonder if you are pounding on the column to cause the "power" relays in the cabin fuse junction panel to make/break?
You may want to pull each fuse and relay, one at a time, and dope up the male spades with an anti-oxidant such as Ideal's "Noalox". The power relays make have dirty contacts ... replacement may be helpful.