Family Law Questions? Ask a Family Lawyer Online.
I will try to best answer your question.
I would recommend filing a temporary protective order based upon past physical abuse and current fear of future abuse. I would insist that he needs to attend anger management counseling and needs a full psychological evaluation as you believe he is suffering from a mental health disorder. If you also believe there is substance abuse issues then that must be raised.
You may not be able to prevent contact forever, but the best chance is to delay contact until he has established there is a safe environment for the same. You should also request any and all contact be supervised contact by a professional. The idea being you want the cost to be an impediment to exercising visitation.
Finally I would recommend contacting the other mothers to see if they would be willing to testify in your case regarding their experience with his behavior and interaction with children.
I hope this information is helpful and I wish you the best of luck.