Replace the contacts in the starter if you want to take a low-buck approach. They are very likely to be the problem. Replacing the starter is a crapshoot unless you buy a really high quality rebuilt or new unit. There are no guarantees that the rebuilder replaced the solenoid contacts and you may shortly or immediately be where you are now.
Don't spray anything inside the starter. The mechanism that is possibly sticking is inside the solenoid.