Small Engine Troubleshooting Problems? Ask a Mechanic Now.
The connection from the pump is supposed to be a check valve, sounds like valve is stuck open or gone. usually a ball and spring in the fitting. Without the check valve, the pressure from the pump goes into the soap dispenser.
Did you find the check valve?