If one is accustomed to driving the Class A, driving it with a towed vehicle ("toad") doesn't feel much different.
Driving a Land Cruiser may feel more relaxing to you, but once you put a 20' TT behind it you will no longer have that feeling. If the A with toad makes you nervous, a TT behind your 'Yota will most likely make you feel that way even more. (Not that it bothers me at all, but I understand.) No, I don't think you would gain anything that way.
Now, if you were a minimalist couple, you might find towing a small popup or fiberglass trailer (Scamp, Casita, etc.) quite easy and it would get you into some national forest campgrounds where the A might be too long. But it sounds to me like you prefer the comforts of a more spacious, better-appointed rig. So why not "dance with the one that brung ya"... keep the A.