Does it only do it on the cold setting
The problem is with the cold watr valve.
Thats why you can only turn off the water by turning off the tap.
Replace the water valve
If its like you say It wont turn off even if its unplugged.
It has to be the water valve