I would leave it alone as odds are you will never hit it. I think the one on my Ram is just about as low and I've never come close even without the camper on board. And I've gone through some places where a straight receiver has drug the ground.
But if you want to remove it, odds are you won't notice any changes because it is such a minor thing compared to the front of the truck especially with a TC. It is more for the 1500 where there are trying to coax every 1/100 mpg out to meet the EPA mandates.