We have been toadless so far. It does cause you to think twice or three times about little trips to town and such. We try to not let it do that, but it just does. You sort of weigh whether it's worth putting stuff away and all that.
Then again, towing a toad is a pain too! Plus the time spent hooking up, unhooking, etc. Time wise toad versus no toad is sort of you can pay me now or pay me later, if you get my drift. Same for convenience too, I guess. It's inconvenient to haul the thing around, but darn convenient to have once you're set up somewhere.
Really, whatever works for you. If you want to go toadless, it certainly is do-able.