Don't forget to see President Grant's home! He lived in Galena after the war. Free to tour...very nice.
Also LINCOLN announced his presidency run in the DeSoto house hotel!!!! Part of his campaign was run from there. Lots of history in downtown galena.
I second Mississippi Palisades SP. No full hookups, but a nice park on the bluffs about 15 miles south of town.