If you’re only running 120V then your neutral needs to be the same size as your hot. As others have suggested, consider one more hot wire. For the incremental cost you get 2x the power available. Even if you still use a 30A breaker, many 50A RV’s would probably be fine with only 30A available per leg. Depending upon your wire size and number of conductors, you may have to increase the conduit size.
Conduit calculatorBe sure to get wet rated wire with a W in the designator.
Don’t forget sweeps (gently curved conduit elbows) to get into and out of the ground plus an L-box if you need to get through an exterior house wall to get to the main panel.