This is a very difficult & distressful situation for you. Life is too short to be miserable and you deserve to be happy. Take whatever steps you can to be happy.
There must have been some positive things that attracted you him in the past. Try to focus on these & on enjoying some time together. I would try to get him to go see a couples counselor with you. He needs to realize that you are not happy in the relationship right now & that you guys need to work on improving the relationship.
If he's not willing to see a counselor I think you should see your own for some individual therapy. It's not ethical to give too specific advice (like whether you should consider leaving him) without getting to know you much better & hear the whole story of your life and your relationship.
If you have any loved ones in your life that you trust, I would also get some feedback from them. Of course, always take everyone's feedback with a grain of salt. At the end of the day you have to follow your heart.
Hopefully you can mend this relationship. If not, you may need to be prepared for the possibility of ending it. I know that would be extremely hard as well...but if things don't change...and he isn't willing to compromise with you, you will always be unhappy...unless you gain enough strength to ignore his negativity and focus on some positive aspects of your relationship.
I hope this helps. Let me know if you need more feedback. Good luck & take care.