Not sure what kind of system you have, but our brake controller has a dial to increase or decrease the "intensity"? When set too high, it will literally lock up the camper tires. If set somewhere in the middle, it is very jerky at low speeds (like in town at stop lights or stop signs). But at higher speeds is much smoother. It's just the nature of the beast.
You have to find the happy-medium that you are getting good breaking from the TT, but not jerk your head off every time you touch the brake pedal.
The goal is for the TT brakes to engage slightly before the tow vehicle brakes engage. Unfortunately, the electric brakes on the camper are either on or off. The tow vehicle is a smooth transition.
So the 'sensitivity' need to be adjusted, and even then, in heavy town traffic, I'll move the controller from a 5 to a 2. Sometimes when driving through the campground, I'll change it to a 1, because even at very slow speeds, a 2 is still to jerky.
Play with the settings until you find the happy spot. Chances are, the second time you touch the brakes, you're moving faster, thus it feels smoother.
I may be completely wrong here, but that's how my controller works.