I do this all time when connecting up my 30AMP trailer. If I see alot of ware and tare on the 30AMP Service I will use my 50A-30A adapter and use that side.
However just a couple of VOLTS DROP is not a whole of VOLTAGE DROP when you kick in something high wattage like the Microwave.
What you don't want to see is the AC Voltage going below the 110VAC level... Some users will accept 105VAC as minimum level to use... I have seen the 30A service in the low 90s at times.
Most campers are the smaller size and only use 30AMP Service so you can imagine what happens to campground grid when most of the users are 30AMP service...
I use one of the RV 120VAC PLUG-IN meter in both my 30A trailers. This is neat because it has the SAFE ZONE painted in GREEN on the scale.

Roy Ken