Of course you're confused. He's giving you mixed messages. If you truly believe that his behavior of his will go on for the next 4+ years, and he won't address his problem causing it, then it makes sense that you would want to break it off.
He may be talking about the space of the place and other things that are secondary to his own feelings and words towards you. It could be a defense mechanism not wanting to address the real issue.