What are your ages?
How long have you been together?
Why do you have doubts?
thank you for that additional info.
Was there something that happened recently to make you feel this way?
Whats different now, than say 2 or 4 months ago?
Nobody wants to be that person, and thats a fact. Whether or not it's safe to stay in the relationship is a judgment call on your part.
Those are all questions you have to ask that can help you gauge whether or not it's worth staying with him. I know that once you start to develop feelings for someone it can be hard to be objective, but the best thing sometimes is to keep that laid back attitude, even when you're not feeling laid back. If he starts feeling like you're moving faster than him, it could chase him away. I don't think that an opposing schedule is enough to call off a relationship if you both know what you want and make an honest effort to spend time together. I welcome your thoughts. Let me know if you want to talk more.