If you have the restraining order, then he can't contact you. You can contact him all you want, however, each time you do, depending upon the character of the contact, you may be providing evidence that the restraining order is no longer necessary and should be set aside.
However, based on your posted facts, it appears that the restraining order "is" necessary, so if he's bothering you, and the precise form of the harassment is prohibited by the restraining order, then you can call the police and your husband will be arrested. If the form of harassment is not prohibited, then you will need to go back to court and have the orders modifed so as to close the loophole.
DISCLAIMER: Answers from Experts on JustAnswer are not substitutes for the advice of an attorney. JustAnswer is a public forum and questions and responses are not private or confidential or protected by the attorney-client privilege. The Expert above is not your attorney, and the response above is not legal advice. You should not read this response to propose specific action or address specific circumstances, but only to give you a sense of general principles of law that might affect the situation you describe. Application of these general principles to particular circumstances must be done by a lawyer who has spoken with you in confidence, learned all relevant information, and explored various options. Before acting on these general principles, you should hire a lawyer licensed to practice law in the jurisdiction to which your question pertains.
The responses above are from individual Experts, not JustAnswer. The site and services are provided “as is”. To view the verified credential of an Expert, click on the “Verified” symbol in the Expert’s profile. This site is not for emergency questions which should be directed immediately by telephone or in-person to qualified professionals. Please carefully read the Terms of Service (last updated February 8, 2012).