Hello there and thanks for asking JA. It looks like your ex husband was manipulative. I think you still have to live with the agreement until you go to court. I think it is wise for you to not break the agreement. It will look better when you get the permanant order. Please write all this down and keep track of things like that. When he is with your daughter he has to be with her. Tell him that you expect him to tell you the truth about your daughter and where she is after all you need to know in case of an emergency. I am sorry that he used your good nature and lied to you. I think the lesson here is to keep to the agreement and not to diviate from it. Tell him that you expect him to live up to the agreement that you have about hollidays. I think what you are experiencing is very common. Tell him that you will not allow him to break the agreement about when he will have your daughter after all your family needs to see her in hollidays also.
I have a feeling you are not surprised at your husband's behavior. I am also curious to see what your daughter thinks about this. I wonder how old is she?