IMO skip the stinky smelly overpriced sea lion caves. We were extremely disappointed and a lot lighter in the wallet. Florence to the North is fun little town for shopping and hanging out for the day. If you like Oysters head into Winchester Bay just to the North. At the end of the pier there is an oyster house that sells some of the best I have ever had. There is also a pretty cool lighthouse at the top of the hill in Winchester Bay with a great lookout. They have daily tours that take you up inside.
If your the adventurous type check out one of the jetboat charters. There is a good one in Gold Beach (to the south) and another in Grants Pass that goes along the Rogue River.