I agree with you. If he doesn't have time to talk as a couple then make time. You already said that he doesn't believe in counseling. There is no other way to truly put this issue to rest whatever the decision. You have to talk about it at length to finally be able to focus on his decision. You can't want the relationship by yourself so there is no other solution. Find out once and for all what he wants. Make a point to tell him what this discussion will be about. That is the fair thing to do. Tell him on this day you want to talk about the relationship. If he appears you know he wants to talk about you as a couple. Set a time and have your thoughts organized. Agree that with this discussion you will have closure. If it doesn't turn out well you have to move on. Consider counseling for all of your losses either way.
If this has been helpful press accept