How do you feel about people walking through your campsite?

If your wife looked out the kitchen window of your house and saw some guy walking by she might be just a little concerned. Seems like the choices here isn't so much doing the right thing since that doesn't seem to be unanimous what is the right thing, but rather it is doing the harder thing.