You have something not quite right. The hitch should be solid when hooked up and you shouldn't be hearing any clunking when starting or stopping. You need to have someone in the bed checking to see where the noise is coming from You've either got too much clearance around the pin, or some mounting parts/bolts are loose.
Get it checked out for your own safety. And ours too. :)