My opinion above comes from two direct experiences that we were HEAVILY involved in:
1. My Mom who did not have enough when she was old and infirm.
2. My Mom-In-Law who did have enough when she was old and infirm.
There was a world of difference between these two situations. I'd give up "building memories" when young any day to never be a number 1. when old. If you're a number 2. in your old age there are dozens of ways to still experience a remaining rich life in ways that are merely different from the way one builds memories when young.
We now know how to build memories sitting in a lounge chair, or hiking, or fishing, or rockhounding with the RV out in the middle of nowhere ... or when at home doing other things.