I agree with your choice...if it's not working do something different.
But I would suggest, filing this away as a learning experience and possibly revisiting in a few years.
It sounds like right now both of you are working full time with no travel while hanging out in God's waiting room...of course, you aren't going to get the experience magical full time RV experience.
In a few years when you have more freedom, it can mean traveling the country seeing new and interesting places. With no work, a little puttering around the RV will be a diversion rather than a chore. If you do hang out down south for the winter, it's 3-4 months and the people will be closer your age and more likely to have similar interests...plus you will have the time to fully partake in the activities (assuming that is of interest).