We've been there as well. Started in the early 1980's with a smaller TC for fishing, hunting, and vacations. Then went with a Class C so we could carry bales of diapers and wife and kids could move around. About the time they hit middle school they had activities about every weekend and all summer. Sold the Class C. Retired and bought the first of 3 fifth wheels. Then bought the Bigfoot.
Just me, but I would keep the TC and look around for a used TT. Cover all bases. Being you have a 2500 I would stay away from all but the very lightest 5th wheels. A TT would give you the option of storing kids bicycles etc in the truck bed.
Good luck.