Question about having camper setup in near freezing temps.

To reassure yourself, fill an ice cube tray, and find a thermometer, and put them in the freezer of the RV.
While it will be below freezing, it won't be as cold as your house fridge. Check how long it takes to make cubes! You'll be surprised at the time it takes. And the warmer it is outside above that temp, even longer.