Water holding tank is filling while on city water

The check valve in the pump is the issue, and if disassembly and cleaning it doesn't fix it, then the quick low cost fix is to add an external check valve on the output side of the pump. Most hardware and home improvement stores will have one that will work.