Hello there and welcome to Just Answer. My name is ***** ***** I will be assisting you today. I am an engineer with over 30 years of electrical and electronic training, repair and installation experience. I will try and answer your question accurately and precisely so that we can get you on your way.
There is no battery in the MH-34 speaker/mic.You are likely looking at a capacitor. Do not disconnect.These mics are prone to solder joint failures. That is likely what is wring with yours and it would need to be repaired. I did see new ones on Amazon for $34.
Let me know if you need further help.