We stayed at this CG in 2013.
http://rosecreekcamp.com/ There is a small mine that you can walk to, not sure if they own it or a neighbor.
We went to a larger mine too, I think it was Mason's, and it was just down the road. Not really into looking for gems but we bought some dirt and had a good time. Had fun and found a few gems.
We had a small TT, so no access problem. You may want to ask them about access. Seems like the turn into the CG was a tight one, dirt road in CG, and a bit of a grade ( heck you are in the hills ). Could be an issue if raining. We had no problem. Sites themselves would be large enough I think. It was about empty when we were there. They have good rates and take PA under certain conditions.
Maybe a local will chime in with advice.