Our kids were never into sports, but they were very involved in musical theater. Starting in middle school, they were tied up at least 2 weekends a month, and more when they were in the final production weeks. We couldn't get very far away from home during those years, but we did manage to carve out about 4-5 camping trips each year.
In 2007, I put my foot down for one summer season. DS(21) was already up and gone. DD (14) was finishing 8th grade and DS(12) was getting to the age where it was harder to manage him away from home*he is severely mentally handicapped and autistic* I knew it was now or never--once DD started high school, I knew we would have very few family vacations or campouts. So I insisted that for ONE summer, we would camp. We took the kids and headed west for a 2 month cross-country trip--no friends, no cell phones, no whining. And it was GREAT! So glad we did it then, because we will never get that time back again.
OP, you have to make your own decision. This is but a short season of your life. If your son wants to play sports, well, that's fine. I wouldn't interfere with that too much. Perhaps you can carve out a few weekend campouts that are non-negotiable, even if you have to do it in the off-seasons.