Thanks for writing to Just Answer.
If a man is looking more forward to a weekend with no plans than spending time with you, it sounds as though he has made up his mind that you are going to be only a sexual partner. His saying this to you (looking forward to the weekend alone) sounds a bit passive-aggressive as well.
I would advise that you not put yourself in a position to fall into bed with him again until he makes it clear that he has come to his senses over your falling out. If he is going to classify you as "just like his ex " over one disagreement, I doubt the long-term prospects of this relationship. You will be walking on eggshells around him if he's this quick to pass judgment and withdraw from you.
He may be doing you a favor by showing his emotional immaturity this early in the relationship.
Think long and hard before getting too attached to this man. Do not let him leverage this misunderstanding into a position of power where you are afraid to express yourself for fear of sounding like his ex. You may have scared him, but instead of talking about it he withdrew and "punished" you by spending the weekend alone. This does not seem like the actions of an emotionally mature man.
This may not be what you wanted to hear, but sometimes people do us a favor by showing their true colors early on...and we are wise not to ignore them.