Ideas on Not Losing the 2-1/2" Hitch Adapter

I'm using my old Equal-i-zer hitch from my old Tundra which had a 2" receiver. Of course my 2016 Ram in my sig has the 2-1/2" receiver. I'm using the slide in adapter supplied with the truck. I've ...