This sounds like your starter is going. The clicking and non start is the give away.
I would guess that the contacts in the starter relay (its part of your starter) are burning out/pitting and have high resistance in spots. This would explain the occational slow starting.