I will happily share part of our site with a large family whose kids sort of "ooze" over the line - I've met some really nice people under these circumstances :-)
The only time I ever objected, was when we were stuffed into a makeshift site that was so close to a camping cabin, that people passing between us and our picnic table bumped into our motorhome and made the dogs bark each time it happened. Rearranged the picnic table and chairs to block that (and didn't stay long)
Otherwise - we're camping. I don't expect solitude or silence when we stay in campgrounds :-)