Hi, Welcome to Just Answer!
I would call it a failing starter. The description you gave is a perfect example of a failing starter. Only way to prove it would be to check for power at the small wire on the starter when it won't start. Definatley not a key issue.
Replacing the starter should cure the problem you are having.