georgia /alabama state parks

Hi all, will be going through ga and al and was wondering if you must have a resv to stay one night or can you drive up and get a spot? Hard to make a resv when you dont know when you will be passing...