In this area I see hundreds (yes hundreds) of small fifth wheels being pulled by half tons. Most are going 30 to 40 miles down the road to one of the state parks or lakes in the area. They are loaded with the whole family, firewood, bicycles, BBQ grills and all sorts of stuff for the weekend. Some are even towing a boat or jet ski behind the trailer. IMHO, If that is your plan then you will have no problems.
On the other hand, if you want to head out on a 1,200 to 2,000 mile trip every year then its a different ballgame. You need a more capable tow vehicle.
Just my opinion.