Depending on the spot, rolling waves can be fairly large, but that is what makes it fun.
Camping at the Gorge must be planned. Two places that work well are both Oregon State Parks; Viento (where we are and where the picture was taken) and Memaloose. Viento is first come first serve but right next to railroad tracks, pretty noisy when the trains pass. Memaloose is much quitter but you must travel to sail. Memaloose can be reserved on line.
I have not found a quite or not crowded place to camp, but like I mentioned, you travel to places to sail depending on conditions. So you are gone all day and return to eat and crash.