You have water leaking into the tank somewhere. There are really only two possibilities where this could be happening: either the fill valve (maybe the handle isn't in quite the right position) or the check valve in the water pump (which is internal to the pump).
Sometimes the water pump check valve leaks because a little bit of dirt or grit gets stuck in it. If this is the case, it can sometimes be fixed simply by using the pump a good little bit. If not, it can often be fixed by disassembling and cleaning. If that doesn't work, but the pump is otherwise okay, it's probably simplest just to install an inline check valve in the pump suction line. (Of course, none of this helps if the fill valve is the culprit!)