We have a ready brute elite and have never taken it off the MH in two years. We use a locking hitch pin and just make sure nothing will dangle down on the road and and take it all over the place either with or without the toad attached.
I really don't think you'll have an issue just leaving it on there and it will save a lot of hassle.
As to the weight, a ready brute elite is mostly aluminum so I doubt you'd find one any lighter.
P.S...I'd also NOT recommend switching to a dolly if you are looking for easier...as it wont' be :)