I doubt that the water pump and heater fan are drawing enough to be causing your problem. The fridge electronics is a big draw as well. It would help to switch out your camper's tungsten lamps for LED ones as that will cut 90% of the draw in this area and is simple and inexpensive to do.
I would be surprised if the 120 Watt panel alone was not enough. We use two 100 Watt panels and they recharge the two 110AH batteries in less than 3 hours. With 120 Watts of output it might take 5 hours instead of 3 but that would not be a problem.
Worth checking your battery to be sure it is actually holding a full charge. I found with my Lance camper that the factory charge meter was not even close to showing the actual charge state. Adding a good digital charge metering device like the Trimetric will provide an accurate way to monitor discharge and recharge.