toad behind Truck camper and brakes question

I have a little flat bed trailer that is typically loaded at 1500-2000 lbs gross and I can feel it push my truck more during a stop than my 6000-8000 lb gross enclosed trailer that has brakes. Your brakes are already stopping the 4500-5000 lbs you have in the bed (TC) - How do you feel about adding an additional 3500 lbs to that brake load? Are you confident you can stop safely in a panic braking situation? I doubt the towd will push you around much in turns or slow you under acceleration but do question how well it come to stop and what type of life you will get out of your brakes.