Hi. The better way to do this is to remove the right side cv shaft and bring the pump out of that hole. You will have to remove the pulley from the pump before removing it from the engine compartment, just angle it down towards you and put your puller on it.
Seeing that you already have the exhaust off, if you want to try going that direction (perfectly understandable) here are the complete instructions in case you didn't have them and missed a step.
NOTE: The exhaust system needs to be removed from the engine to allow for an area to remove the power steering pump from the vehicle.
NOTE: Before installing power steering pressure hose on power steering pump, inspect the O-ring on the power steering pressure hose for damage and replace if required.
CAUTION: The protective heat shield sleeves must cover the entire rubber hose and hose to tube connection portion of both the power steering fluid pressure and return hoses This is required to keep the power steering hoses from becoming overheated.
I have the steps, but silly me expected it to work. Will it physically fit out the exhaust tunnel if it is already open?
By removing the "exhaust system" does it mean the manifold too? All I did was break it at the converter and remove that, the manifold is still in place.
If I go out through the axle space, will there be room to press the pulley on the pump once installed?
Just a follow up.
I removed the axle and was fiddling around with the pump and it literally fell out in my lap, with the pulley still attached. Apparently, with the cat converter AND the axle removed, there is enough room in the center of the frame for the pump to come out. Or maybe I just got lucky. Now it will be easier to get the pulley off and back on externally and slide the whole assembly back in. That's tomorrow nights project.
Thanks again for the help!