We don't mind having some family around, but what gets us is the lack of help doing the chores. When my mom comes we love it because she's fun to have, the kids love it and she helps. Mom gets full use of trailer and I wouldn't have it any other way.
We had some other family come and they didn't sleep in the trailer, but we did offer the use of our kitchen. We ate as a big family outside. They'd cook the meal but then disappear when it was time for clean up.
I wish that they had their own RV. RVing with friends who have their own RV is pretty fun.