You should consider the incident in question. You may have overreacted a little but he was at least a little rude as well. Usually early in the relationship the other person is very intent on making the date feel special even when in public. You want that person to like you and your company. Usually the relationship is at its best and you want the person to feel special. If he is already ignoring you that is a sign of things to come. Not taking the initiative is also a problem. When one person puts forth all the effort then that person ends up feeling resentful. This too is a problem if it is already happening. He should want you to know that he wants to go out by showing you that he can take the initiative. He is not doing that and is has only been several weeks.
I think these are red flags and a sign of things to come. If there are these issues when a relationship is fresh then what is down the line may be worse. I think he sounds insensitive and that is not a quality you want in a partner. I would consider moving on. He may not even notice.
Please press accept; this is the only way I am compensated