Water leaking from overflow valve on city water

If I am using city water, why is the pump mentioned as a possibility of the reason the overflows are leaking water when on city water as I thought the pump is only used with fresh water tanks. Am I wrong?
Also, how does one shut the valves please as this has been suggested? I have a shut off valve that stops water going into the fresh water tanks but have never closed the overflow valves.