I've towed both and a 5er does tow better. My travel trailer pulls perfectly fine 99% of the time but there are occasional situations where it gets to feeling strange. The last time was behind a car hauler, felt horrible. Got past him and all was well. The only issue on a 4600 mile trip. On that trip I had the fuel pump go out on my Suburban 25 miles from home and was using my fathers 2500HD with a Duramax (2006 LBZ). He tows a Cougar 5er that weighs quite a bit more than my 7500 lb loaded travel trailer. Using his truck I got about 1 mpg worse than him overall. I was traveling slightly faster than he normally does, but one day I tried driving 63 mph like he says he does and the fuel economy was no different for me than 65-67. I averaged around 10.5 for the 4600 mile trip, much better than the 7.5 I would have gotten with the 8.1L in my Suburban.
I would miss the storage for bikes with a 5er, with my parents and just 2 bikes, they use a bike rack on the back of the 5er. I have 5 bikes to bring along and they go nicely in the back of the Suburban and would in a truck too of course. You could put them in the trailer (been there done that, don't like it) or on a bike rack on a 5er hitch as well. Makes carrying Kayaks more difficult as well, 4 go nicely on the Suburban, not so easy over the front of the truck if you have a 5er. If the storage differences meet your needs, a 5er is nicer to tow and has more interior space for the same truck and RV total hitched length.