Best hauler for our needs?

Guys I know I've asked several questions lately but this may sum it all up to help us decide. I'm hoping to use halls experience to guide us.

My wife, two daughters (5 and 3.5) and dog need a toy hauler to carry our golf cart and bicycles around with us when we go. We typically take 3-4 day weekend trips every 2-3 weeks during the summer and a few in the fall. I will be using a 2015 Chevy 3500 Duramax (single wheel). At most we will do 1 full week during the summer. Our typical trip is 1.5hrs to the beach.

We have wondered if we need the extra half bath and the side patio. While we love these designs, I also know they have reasons for us not to get them. For example - We used to have a 21ft center console that was the perfect boat for us. We then bought a bigger 26ft, dual engine center console to go offshore more. That extra 5ft made all the difference in the world. For a full day on the water, the larger boat was better. But, it was much more effort and made us dread going to put it in the water for small afternoon trips.

I don't want the RV purchase to be like that. Right now we have a Grand Design Imagime 3150 bunkhouse travel trailer. It's pretty easy, except for the loading everything on the back of the truck which is next to impossible if carrying the golf cart. We are going to continue doing the long weekend trips. I feel like if we were doing a few weeks at a time the larger, side patio, dual bathroom toy hauler would be best. But, to keep it fun, and less stressful doing the multiple, short trips, are we better to get a smaller toy hauler with two axles, less weight, less sewer hoses, etc? If so, any recommendations?