Saturn 2002 SL sometimes will not start

Well car has been running great but last night I went into the store and came out (5 minutes or so) pushed in the clutch and turned the key and all the lights were strong and bells and whistles but the starter did not engage. I walked home after that thinking maybe a fuse or connection. I went back the next day stupidly did not try to start the car but pulled all the corresponding fuses that I saw on google under the hood and on the small fuse panel and all looked great, I turned the key and started right up. I drove it to work started it every break and when I went to start it to leave the started would not engage. I had some friends push it off and I got home and turned it off and it started right back up no problem. Any ideas? Mind you it is colder than normal in fact last night it snowed 6 inches which is not normal for here and then at 2:30 in the morning when I left work it was just below freezing, not sure if temperature has anything to do with it but I wanted to give all the facts. Hope I was detailed enough. Thanks in advance.