Problem starting - where to start?

Just bought a 96 Cavalier.

Today went to start, and it won't fire up. The best description I have right now is:

Dash lights come on during ignition.

It sounds like the injector giving a little hum, but then nothing from there. No click, no turn over, nothing.

Could this be the starter? What should I be checking for?

Check the the starter and see how it looks, it is pretty easy to take off, also check your ground wire, that usually causes alot of problems., but make sure your battery and postive wires are good while your there