We have been fulltime RV travelers (not sitting somewhere in one place in an RV for more than a month, and even that's rare) for over 13 years. My DW and I were sitting around a dwindling campfire 15 years ago, contemplating a return to the workaday life (me at 48, she at 44) and asking, "Why aren't we doing this all the time?" We started planning that day and were unencumbered by debt (never were), "stuff", or sentiment a bit over a year later. We were of modest means then and still are.
Notice the lack of debt. That is absolutely key. And no, we aren't "want" for anything. Excepting caviar and lobster (we STILL do those occasionally) I defy you to name something that you have in your sticks and bricks that we don't have on board, AND can use in many places that most will never see.
Don't let the naysayers get you down. We've traveled from Alaska to Central America and back again a few times on a budget that a few people have called me a liar about. And no, we don't live/travel in trailer trash. Live your dream. You're not getting any younger and you are definitely not getting out of this alive.