As a kid, we had 5 acres backing up on state forest land in Michigan. It was close enough to the road to we got electric in and we had a well but it had a hand pump. A couple hundred yards back in the woods we build an outhouse.
Biggest thing is to check the local regulations and utilities. If it's remote getting power in can get expensive. Likewise, can you sink a well of reasonable depth at reasonable cost and find water? If you want to be able to dump, a septic system is needed (the outhouse was 50yr ago and I doubt my dad pulled a permit).
It's certainly possible just is it worth it. Keep in mind, you will likely be paying property taxes and in most states property taxes are significantly higher if it's not your primary residence.