Your decision must include that you can't have both. I understand what you are saying about your husband's hobbies. When a relationship isn't nurtured it begins to fail. You can't have a relationship survive if one or the other spends all his/her time doing something else. You begin to feel neglected. That is probably the reason that you sought out or even accepted attention from another man. However you should consider that this man may not be as attractive if your husband was sufficiently involved in your marriage. It is possible that the luster would wear off if your marriage was a happy one. You need to evaluate the benefits that this guy offers if your marriage was over.
An alternative to making such a drastic choice would be to find a marriage counselor. But that has to be based on you pursuing what you want. You would have to motivated to improve your marriage for this to help. If it's not what you want then you shouldn't pursue this option.
Before you do anything you have to consider what the benefits of either one are going to be. If he doesn't get you then maybe the understanding is not there to make the relationship work. But maybe this other guy is not as perfect as he seems when you are not seeking attention that your husband is not willing to provide. The decision is yours
If this is helpful press accept