We visit Fort Wilderness at least once a year, usually twice. We go just for the campground. It's been about 3 years since we last went to any of the Parks. There is so much to do at the campground and Wilderness Lodge, we don't need the parks.
Yes, for a campground it is expensive. However, it is the cheapest accommodations at Disney World. We don't go on vacation to watch TV, so having only a few cable channels isn't a big deal. We've stayed at Full Hookup sites, Preferred sites and Premium sites. Just like any other campground, some sites are closer together than others. Most of the sites we have stayed at are wooded with lots of wildlife nearby: lizards, frogs, turkey, deer, armadillo, etc.
We like to visit the Wilderness Lodge, only about 1.5 mile walk or bike ride from the Settlement. Talk the exercise to the Lodge at dusk and enjoy being surrounded by deer that let you get very, very close to them. We walk and bike ride all over the campground. Have never needed a golf cart or a car at the Fort. Our kids really enjoy searching for the hidden Mickey's at the Lodge and at the Villas as well. Some of them are really cleverly hidden. You can easily spend a few hours doing that.
My daughter rides horses, so we also enjoy going to the stables and visiting with the horses. Some of the old time cast members at the Settlement are just fascinating to talk with. Josephine at Trails End has been with Disney since the Fort opened in 1974.
We've stayed at the DVC Villas at Saratoga Springs, Wilderness Lodge and Animal Kingdom Lodge, but we still prefer Fort Wilderness. The DVC villas can go for $400+/night and aren't much more than a standard hotel room.
Fort Wilderness is the gold standard of campgrounds as far as we are concerned. We have yet to find another campground that comes close to it.
When we lived in NJ we towed our HTT to Disney. It's an easy ride down I95. Like others have said, just avoid Philly, Baltimore and DC/Northern VA during rush hour. The rest of the trip is a breeze. Now that we live in GA, it's only 220 miles to the Fort.
-Michael