Are you also living in the home, or do you have another residence you are currently occupying?
You definitely need to get a lawyer involved. You need to present him with eviction papers and I would get anything that is of value out of the house and put into storage or with family for the time being....if you could also move out temporarily and stay with family or a friend until the eviction process is complete, that would probably be a good idea also. I would also strongly advise a restraining order to keep him away from you and make sure you have your insurance up to date on the house.
He sounds like a real piece of work, and I would let the police and your lawyer know that he has threatened to destroy your home if you try to get him out. You need to have the police let HIM know that they are aware of his threats and if anything happens, he will be charged. Ultimately, getting a legal eviction going is probably your best best right now along with keeping him away from you. I empathize, as I'm certain you are scared and confused. If finances are an issue, visit your local legal aid office. They can help you also.
Please let me know if I can help further in any way.