If you are judging that the batteries are fully charged by the little 3 or 4 red light meter built into the trailer that's not a good reading. That little meter is useless. You would need either a battery gauge with a shunt to measure amp hours in vs. amp hours out or you would need a hydrometer to know they were full.
I suspect one of your batteries has a bad cell and thus they both need replacing. Another possibility is that you have some very poor, loose, or coroded connections that are a high resistance under load.