Living most of my life in snow country I have always had 4x4 trucks. When deciding on and expensive diesel to pull my fiver I really didn't even consider 2-wheel drive.
After the first few months of full timing I recall thinking that I may have made a mistake and should have went with 2-wheel drive since I really wasn't using my 4x4 option.
Then we ended up exploring one day. Our sightseeing took us up an old fire road on the side of a mountain in New Mexico. Couldn't have done it without the 4x4. A couple months later had to use it again while maneuvering in a wet tight campground.
I look at it the same as having a slider hitch on a short bed truck, you may not need it very often, but if you do it is sure nice to have.