OP here.
The campground was designed to be facing each other. The shared space was getting smaller and smaller on our side. There was no communication from the other site that they were just going to eat and disperse, if so it would have been a bit more tolerable. The first night the campground was very relaxed and we didn't hear much from anywhere else.
This KOA was not a resort, very basic amenities and I did try some mom and pop places nearby but all were full.
We teach our son and his cousins that camp with us to be respectful of other campers sites, never cut through, keep noise level down and play with other kids in the campground in the common areas unless invited by the kid into their site. He was sitting there watching in disbelief of the others actions.
Our biggest fear was it was going to be an all night thing and we wouldn't have the owners support at that late time.
Also, these were all campers at the campground, no visitors. They were either tenting, rving or had a cabin elsewhere on the campground.