For local camping we like to leave on Sunday morning. This gets us to the CG (usually 3 to 4 hours away), just as the weekend crowd is departing. Lots of site choices and they often come with free firewood. We usually head home on Friday morning and leave the weekends for the working folks.
On longer trips we like to travel Monday thru mid dayThursday and get settled in someplace and avoid the heavier traffic found on Friday - Sunday. Where ever possible we flat out avoid all of the holiday weekends, just too crazy out there for us. :C