I have a family of 4 with a 4 year old and 6 year old and we camp with other families all the time. We usually dry camp at remote locations near lakes and sometimes with lows in the 20's or 30's, the weather is too cold for little ones to sleep in a tent comfortably. I have no problem sharing sleeping space. The only time we're inside the trailer is to sleep, so it really doesn't matter to me. Sometimes after the fire, if the kids aren't passed out, I'll fire up the satellite and let them watch a little TV.
When we go camping, there isn't a debate about when we're eating or sight seeing. I eat when I'm hungry and anyone that knows me, knows that I'll be fishing all day long. Feel free to plan your own activities when you're tired of fishing with me.
Whether you like to camp alone or with friends or family, be safe, be prepared, and have fun.