There are only two possible options:
1. Leaky (or not fully closed) fresh water fill valve, if you have such a valve to fill from the city water inlet. Some RVs only have a gravity fill, and this wouldn't apply to them.
2. Leaking check valve in the water pump. This most commonly is due to a bit of dirt or other buildup getting stuck in the diaphragm, and sometimes heals itself with a bit of pump use as the speck of foreign material is washed out. It can also be due to wear, in which case the solution is to either rebuild the pump with a new diaphragm (not too hard or expensive), replace the pump, or install a secondary check valve in the suction line to the pump.