Well, I didnt get much chance to test tonight as we are in the midst of moving. But, I tried various combinations of breakers and don't think I learned much.
If I leave the main breaker on and turn all the others off and plug in the RV it won't trip the GFCI. I can then go into the RV and turn on every breaker and stuff works. I can run the microwave, I can turn on the fridge in electrical only mode. I didn't try to turn on the water heater. I am letting it sit overnight with all the breakers on to see if it trips the GFCI overnight.
Everything would work in this scenario above UNTIL I turn on the AC. The AC compressor seems to trip the GFCI (not the breaker) everytime. Maybe my compressor is bad? If I turn on just the fan it will run fine.
Anyway, looks like I purchased an electrical gremlin. I will have more info in the morning.