How long of a trailer is too long?

I am looking at toy haulers. We have seen some things we like that are a bit bigger but we know bigger isn't always better with RV's. We're looking at toy haulers but it will be for general camping us...