I hope this message finds you well, present circumstances excluded. I am a licensed attorney with over a decade of experience handling matters like this one. It is a pleasure to assist you today.
The answer to your question depends on the wording of the contract that you entered into with this hosting company. That said, in all likelihood you can get out of the first contract based on breach of contract for non-performance.
So, you need to look at the notice provisions for termination in the original contract that you signed with them. It is best to follow the requirements if possible. That said, the company breached the contract, and as such, you can and should be able to get out with proper written notice to them.
You simply need to send them a certified letter with a return receipt in which you cancel the contract based on their material breach. If possible, follow any notice provisions in the contract and cite those provisions as to the length of time notice should be given in the event of a breach. If there are none, then you can simply cancel, effective immediately based on the issue at hand which constituted a material breach.
Ask that they respond to your letter in writing with an acknowledgement either via email or letter within 5 business days of the post mark.
In short, if you can use language in the contract in your letter, it is best. However, if you cannot, at the end of the day, they effectively nullified the contract with their breach anyway.
Let me know if you have any other questions.
Please also rate my answer positively (three or more stars).