I don't think your plan is crazy or anything, but it doesn't make sense either. Considering you are living in the area you are pretty much tied to, why not find a seasonal lot and park your camper there. You have the benefit of your current residence, the child has stability in the same school system, and you don't have to relocate because of your job. Your house will continue to grow equity, sell the second property and be free of it.
In the summer you can stay at the camper in the seasonal site, you can go back to the house when needed, and you can still enjoy the camper any time you want, week-ends, extended stays, holidays, pretty much whenever you want.
In a way, we do this with our camper. We have our own house, it's in the country, we're zoned agriculture, so we can do pretty much anything. We have the camper on our property, and during the summer, pretty much live in it (right at home). We have the benefits of the house when we need it, and the joy of the camper always with us. Nothing wrong with drive way camping.
Like you, we're not ready to pull the plug on our jobs, but surrendering the house to live in the camper and continue working at the same place, just doesn't make a lot of sense.
So, why not set the camper up on your property? If you can't because of your local zoning, the consider a season site. You'll have the best of both worlds then without giving up anything!