I had a truck camper for many years. When I got married, we kept it and went on many fun trips with it. One child, TC got a little tighter but still bearable. Two kids, no chance. Sold it and found a small bunkhouse C. The smaller the C the more leftover capacity for towing is my experience.
Took a few years before the youngest slept in the bottom bunk but now she loves it, and our older girl loves the top. When she was real small we folded down the dinette and set a playpen on it for her to sleep in. Our older girl is teenager now and is to the point when she brings a friend she would prefer to sleep in a tent outside so for us that makes extra room for friends a non-issue.
We have never towed a vehicle, we are almost always pulling either a small horse trailer with horses or a flatbed with quads and the RZR. We have never had any issues parking. We don't leave much out so breaking down to go to town is not an issue for us. But honestly we don't "go to town" much because like you we are just weekender vacationers so when we tear down it is to go home. No real issue leveling I have a few sets of the lego levelers they work great. Towing a few thousand pounds is fine too.
We love our C now for the way we use it, but when we are empty nesters we will probably go back to a TC.