In 40 years of near daily carrying, I have shown my firearm only a handful of times and only drawn it once. None while camping. So statistically I could say no. But if another need arose, and I didn't have it, that "statistic" kinda goes out the window.
Your best deterrent is situational awareness, for the times that fails you being OBVIOUSLY armed will usually avoid a need for it to leave a holster, when that point is passed,,, Having it, and knowing how to use it is a much better option than counting on the good will of the person confronting you.
It's a personal choice, make the one that suits you, and under normal circumstances, it's nobody elses business.