Being happy with how it tows is a matter of opinion and my opinion is the 5.0 F150 I had pulled as well as the subsequent 6.2 F250s that replaced it. No it didn't have quite the mass or the 250 and yes I'm certain I was over the rawr a lot of days, but power and braking (trailer brakes y know) was on par with the bigger truck.
Would a 1 ton diesel with 900ft lbs and 8000lb curb weight do better? Of course, but so would a semi tractor.
The OP did not make a bad choice, he made a compromise between the intended uses of the tow rig and it's not a bad compromise.