Thanks for the clarification.
The first thing I suggest you do is instruct a Solicitor to act on your behalf.
The Solicitor should make an application to the High Court for an injunction preventing removal of your husband from the UK. At the same, time, he/she should send a letter before action to the treasury solicitor (Solicitor acting for the UKBA) and set out the claim, making reference to any human rights claim.
Once he has done this, he will have to make an application for Judicial Review to the HIgh Court. It will then be up to a High Court Judge to decide. During the process, an application for bail should be made. If granted, your husband will be released on bail pending appearance at a hearing.
The best thing you can do at this stage is instruct a solicitor. If you can let me know what town you are in, I may be able to locate one for you.
If you wish to discuss, please feel free to ask further questions.