My guess is that you need a starter. But, anything is possible. If you hear clutch switch each and every time (it is supposed to be about 3/4 the way adjusted down - to hear it), then the switch is good. AND, they don't go bad often. My guess above .... is because if the solenoid portion of the starter is bad or going bad, after trying a few times, it will "arc" itself in to working until one day it will no longer work at all.
Good Luck. Please press ACCEPT. Also, If I have been helpful, please leave positive feedback. This is how we are judged. Thank You. Dave.