Connected battery and car started

My old battery died so i went and bought a new one and while i was hooking it up i connected the positive and then went to do the negative and everytime i would put it on the car would start up