Hi. I'm online and happy to answer your question today.
I do not think that your glasses are the source of your difficulty.
The good news is that wearing or not wearing your glasses, having panic attacks concerning your eyes or your glasses will not affect your vision or your eyes in any way. I am sure this in and of itself is good news because now you don't have to worry about your eyes so, hopefully, your panic attacks will decrease.
And, now, the obligatory word from our sponsors: :o)
I hope that this information was helpful for you. Please, allow me get credit for my time and effort in assisting you and press the ACCEPT button for this assist. I will be glad to answer additional questions until you are satisfied. Thank you very much. Positive Feedback and/or Bonus is welcomed and appreciated.