I would say don't rule anything out at this point. I would start by looking at floorplans and figuring out what length works best for you. Then you can figure out if an older or newer one would work best.
I didn't downsize, but I really love the layout of my clipper. It works perfect for me and I have not yet seen a newer floorplan that would be comfortable for me and the way I use the RV.
Mine is 21ft and I do not have a toad - it works for the way I use it. Depending on how you use yours, you may be able to go as big as 27ft without a toad, or you may find you need a toad even with a 24ft.