Thank you for your question.
Given these facts, I would say very good. First of all, it sounds like you can more than prove that there is no good basis for the contempt motion. Furthermore, even if the judge ruled you had in fact denied him visitation
in violation of an existing court order, it is not at all likely that they would award the father custody as a sanction -more than likely, they would do something like award make up visitation.
Secondly, if the father wanted to try and establish a change in custody, they would have to prove both that there has been a significant/substantial change in circumstances since the previous custody order and that it is in the best interest of the child
that the court modify custody. This is an incredibly high burden to meet, because judges in family court are reluctant to change the "status quo" in absence of strong evidence. If your child is safe, happy, healthy and doing well in your care, there is no reason for the judge to modify custody. If you need me to clarify any portion of my answer, or have additional follow-up questions, please reply back to me by selecting the continue the conversation/reply button, and I will be happy to assist you further.