Arbutus Cove B&B is very nice, though it's been over 10 years since we've been to Victoria.
Our first trip, we walked through Victoria; really beautiful. Next two trips, we took our rental car and roamed all over the immediate area, then took the gigantic BC ferry to Vancouver and up to Whistler. The drive back was very nice, though some can be flat.
If you have time, a state ferry trip to one or more of the islands is nice. I believe we went to Friday Harbor and stayed at a real nice B&B.
Sequim is a nice little town. Amazing that they have very little rain due to the mountain shadow (something like that). They have an Irrigation Festival sometime in the summer that sounds like fun.