The negative energy comes from people that have been in the situation you describe or summary or random people such as yourself that have already done it. 5500 pounds dry means 6500-7000 pounds loaded with 9000+ pounds of loaded TW. That puts you right at the Navigator's GVWR and those estimates are likely low especially as your family grows. Have you ever driven your vehicle at GVWR and understand how it handles? RVs are difficult to tow. The high front and side profiles make and change in air (from other vehicles, cross winds, etc) move affects the whole combo. As much as people like to focus on power and fastest time up the IKE Gauntlet, stability/handling is the most important factor in how the driver feels after towing to a campground.
You are welcome to try it. But before you do, have a plan for what if you are wrong or uncomfortable with the towing experience. Are you then willing to replace the TV? Replace the RV with something smaller?
