Hello, Thank you for using justanswer.com. I'm sorry to hear about this issue. It does sound like he is obsessive about this hobby of his and that it is effecting people in his life.
If he is unwilling to acknowledge this nor seek a professional opinion about this, there is not much you can do. You ask "do I have a right to be annoyed?" Yes, you have a right to be annoyed but this doesn't help the situation much. All you really can do is express your concerns and then set boundaries around his discussion with you around the hobby. For example: you may decide you do not want to have "mutual" funds spent on this hobby. You may ask that he spend one or two nights a week with you 'date night" without discussing his hobby during that time. Or you may decide to set the boundary that he not discuss his passion with you nor involve you in any aspect of his hobby. If he respects your boundaries around this issue then you may be able to let go of this anger.
If he accepts your boundaries and you are still unhappy you may decide to ask him to go to marriage counseling with you to discuss this issue further or that he seek help for the fact that his hobby is ruining your marriage. If he refuses this, I would suggest getting counseling of your own to help you make further decisions about your marriage.
I hope this answer helps.
Please let me know if you have further questions or if you need further clarification about this answer.
All the best,
*Please click accept if you found this answer helpful.