I don't know how far is too far for you. When we stayed in Clerbrook a couple winters ago, we would drive over to Brooksville to have lunch or dinner with friends. It was 45 miles each way, about an hour, with NO toll roads.
Some other options where friends have stayed and enjoyed the stop. A quick check of web sites says nothing about 55+, and the friends who stayed in those were under 55, but it has been a few years.
Covered Wagon - Homosassa
Sumter Oaks - Escapees - BushnellBlueberry Hill - BushnellCampers Holiday - south BrooksvilleRock Crusher RV - Crystal RiverRock Crusher was very popular with come folks on this forum in the past. While staying at Crystal Isle, we visited the park, and it looked quite nice.