I towed our trailer into LA with the family to take the kids to Disneyland and etc last summer. I wouldn't say it was fun navigating the freeways while towing but it wasn't too bad. My oh $hit moment was coming in on 14 where it merged into 5 headed south. I've never seen that many lanes come together and split apart anywhere else. Holy...
But aside from that it was fine. We stayed at the Anaheim RV Park which was actually pretty nice. Probably not ideal for trying to go surfing, though.
When we left I got prepped the night before and then woke up at 2:00. Got the kids and wife loaded up and we were out by 2:30 and had breakfast after passed through Vegas. Part of that was to avoid any traffic issues but also to make the trip home in one day. It was a long day but it worked well.
As an aside we came down via 95 and cut over into the Owens Valley by Lee Vining and then south down the valley. Very scenic views of the Sierras all the way through albeit pretty crowded. But it's California so I guess crowds are what you get.