I am sorry to hear of your pain around this fight and the break up. I think he needs time to sort it all out and let his anger calm down. If you can take a step back and give him the time that he needs, then there is a possibility, he will miss you and your time together and reach back out. It is excruciating for you to wait, I know, but it is your best course of action. How long do you wait? Hard to put a time frame to that, but letting him calm down and letting this all play out is your best hope. As he said, you going to see him did not help, so try and breathe and care for yourself while you pull back. If the happiness was there, then give him some time to remember that and come back.
Let me know your thoughts.