I have the same issue. I live in a rural area but my street is one of the paved ones.
I have a large curve on one side and a hill on the other. It never fails as I arrive home, there will be no cars either way.
When I get to top of the hill at my drive and stop...then there will be 5 cars waiting on both sides.
I back a 40" DP in my drive with a gate 12' at front by road. Takes a couple of maneuvers to get it in.
One day a biker decided he wasn't gonna wait on me, he took off around in the grass and almost wiped out.....
Some people expect you to hurry and risk hitting something...I take my time now....