If it fits within your ratings or the numbers you are comfortable with then it is not a bad tow vehicle. My friend has one and loves it fr his 10k bumper pull. He gets about the same fuel mileage I did in my 2014 2500 Cummins when it was stock. We both drive the same always doing 5 over in a state where the speed limit is already 75 mph. I think the problem with comparing fuel mileage is that you don't know how the other person drives and that can swing the mileage by up to a 40% difference.
The other thing that gives the XD a bad rap is the non full floating axles and other things that most 3/4 ton tucks come with these days(even though some didn't a few decades ago). You will mostly get this from people who generally like to over compensate(the "you can never have too much truck" people) and/or believe that factory ratings are law(which they aren't). The XD will be more than fine for what you are pulling and you be happy with it. I would rather pull it with that than most N/A gasser half tons that's for sure.