So it sounds like YOU are the one that wants to do this, not the wife.
One thing that's important to us in traveling is being able to view things as a couple and talk about what we're seeing. It's part of the whole 'experience'. It definitely wouldn't be pleasant to be driving alone - for us, anyway. Everyone is different.
Depends on where you're driving but navigation could be a problem, too. Having an extra set of eyes looking out for turnoffs or traffic hazards is a plus.
We thought like you after 8 years of a 5th wheel and driving the big truck. We moved to a motorhome towing the Jeep for the next 8 years and it was wonderful. The Jeep gave us a lot of entertainment. We enjoyed getting off-road and exploring. We also loved geocaching and the 'find' took us to many backroads.
Also, why wouldn't you be moving? That's the joy of full-timing!
Since you've been thinking of this, give it a try.