I agree with you. You should certainly not have to pay for any monies that they charge because of their error. And most assuredly why would you pay for the money they have to pay back when they received it first?
I believe that you should be paying for all the taxes that you owe plus any penalties and interest.
As well, if this went to court you might have to pay any fees they incurred when dealing with essentially foreclosing on your property.
I suggest that as your next step in the local lawyer send them a letter threatening a lawsuit.
It is very likely they will back down once they hear the lawyer's logic and hear that the lawyer will be involved in suing.
Of course, if you do have to go to court to be much better to self represent because the legal fees will more than what you are fighting for.
Does that help as a starting point?
Please feel free to post back with any follow-up questions you may have. If you don't have any then I hope I have earned a 5 star rating but if you don't feel that I have please don't hesitate to reply back and let me know what more I can do to assist you. Finally, please know that even after you rate me I will be here for you and you can ask follow-up questions if you think of them later on at no further charge of course.