98 sienna blower issue

Intermittantly either frt or rear or sometimes both blowers are inop. Ocassionaly hitting a bump or playing with the mode selector on the frt unit causes the blower to start again, but sometimes it takes days to start again- but not everytime. Is there something simple to check out, problem is so intermittant at times dont think taking it in would do any good. Thanks for any insight.