A dolly is a necessary evil for anyone who owns a car that is not towable four down. When we owned smaller motorhomes we never used a toad but as the size of the RV increased we found like you that we were missing out on too many things. We towed a dolly for several years and found that the biggest downside was probably what to do with the dolly after we arrived at a site. Second dislike was the time it took to get the car on the dolly and strap it down. This was especially irritating when it was raining.
Get one but, my recommendation would be to make sure it has brakes.