You should speak to the bank personally and find out why they are giving you a credit socre of 568. That is not a reson to deny you, and if you go to a mortgage broker they will definitely find you a mortgage company who will give you a loan secured by your townhouse.
Please rate 4 or 5 and close out the question. Good luck to you. I wish you all the best.