Fan for air conditioner not working

It started a few weeks ago. At first, when we turned the AC on, there would be no fan and then about 10-15 minutes into the drive, the fan would start to work normal. Now the fan doesn't come on at all. What would be the cause of this? If it never worked I would say it's a fuse or something like that. Since it does work sometimes, could it be a loose connection or a bad fan motor?