My father passed away from Non-Hodgkin lymphoma at the age of 52. Before he passed and while he was still able, my parents did what they enjoyed doing most and money was put on the back burner. Yes money was very tight, but in the long run happiness comes first. Some of my mom's best memories are of this time. Mom had no incoming income and dad had his own garage. But once he got sick there was only the insurance check coming in. He was the only employee. I know she has no regrets on not having any savings.
Think about it this way.. How happy are you and your wife gonna be if you do give up RVing? What is more important? Saving up for what might happen or doing what you love while you can. The future is a big question mark. So live for today.