stopping for a single night - rest area or rv park?

If you are driving till after dark and leaving early then use a rest stop or walmart...no need to bother other campground guests with a late arrival and early morning departure. I think some posters here just dont feel safe if not in a campground!