Hello My name isXXXXX will be glad to assist you today in answering your questions.
This sounds like the a/c control module (which is the a/c control panel) is going out on you. If you have access to a vagcom scan tool or know a independent they should be able to check codes for you and see if there is a reason for this problem. The control modules usually can be repaired by a couple companies that are online. You send them yours they fix it and send it back. You reinstall it and that's it.
Check out bba-reman.com I would check and see if they can repair your unit.