I started same as you, with a half ton that I put bigger springs and tires on, a camper and a 17’ boat.
I managed to have a lot of fun with it. I also managed to break the rear axle lol... and the thing wasn’t fun to drive. It always felt like it had too much on its back.
I hate to jump on the “you’ve got the wrong truck” bandwagon... but you’ve got the wrong truck.
3/4 or one tons handle SO much better with a load.
A really basic small camper with nothing in it will be light enough but there aren’t many like that.
They exist, Four Wheel Campers are one of the main go-to rigs. But they’re not really that light.