Nobody has mentioned it, but you originally stated:
"SRM29 Interstate Deep Cycle battery, 675 cold cranking amps".
This tells me that your battery is not the type of battery you should be using for your rv. Any battery measured in CCA (cold cranking amps) is designed for "starting" as they supply a high number of amps for a short period of time. Discharging them will significantly reduce its effectiveness to hold a charge.
You really need to look for a deep cycle battery that is measured in Ah (Amp hours). Those are designed to have repeated discharge/recharge without significant damage to the cells and its ability to hold a charge.
As others have mentioned, your rv has parasitic loads that will discharged the battery even if nothing is turned on. You need to disconnect the battery and it then should hold a charge for a longer period.
Also, your converter may not have the three stage ability to "float" charge your battery once it is fully charged. Continuous charging can damage the battery as much if not more than discharging it.
Hope this helps
Ron