For your proposed usage I'd say it's the Hemi without a doubt. I just went from diesel to Hemi 6.4 for my 8500# TT and it's a great fit. The Hemi is a real game changer for loads up to around 10K. Much north of that and/or towing often a diesel might be better.
I had pretty much the exact same decision as you. A tradesman diesel or a well setup Hemi. With your usage as a daily driver and modest TT it's a no brainer. The Hemi it more than capable and the bells and whistles on an equipped truck are really nice.