There are a lot of things that disable people, and SSA recognizes many of them. Anxiety is one that qualifies.
I assume you are under age 66 for a social security retirement, so social security disability is your next best step to supplement your other income.
I'm not going to address working part time, or working in a less physically demanding specialty. My response is meant to focus on disability only.
The system recognizes your condition as disabling, so you should qualify for benefits, with your doctor's diagnosis and support through the application process.
Your financial condition will have an impact as well, but if you can't bear the thought of working, then you can't work. And that's what SSDI is all about.
Consider applying, and asking your doctor to support your claim at your dr. appointment.
Also consider engaging an attorney to assist, as claims without legal 'pushing' can take months or years, and that has to be considered as well. An attorney will be worth their time and effort, as their claims seem to get more respect from the agency (one practitioner's opinion). And you only need to worry about other things.
I hope that addressed your concerns. If so, please rate my assistance with positive feedback. I'mCustomer