I'd love to know what the actual regulations are on this when you are at a gas pump. I was in the gas station business for years and thought I knew all the regs, and I never heard one about RV propane appliances. I understand the concern, believe me.
There are regs requiring explosion proof and intrinsically safe conduit/wiring, motors, switches, lights, etc. at the gas pump location. There are zones described, and outside of the zone the requirements are relaxed or gone. I seem to recall that at a gas pump, the zone is 0-4 feet up from the ground, since the fuel vapors are heavier than air and hang out at ground level. The RV fridge is usually up around 4 feet or a little higher. But, I could be all wet, my memory is pretty hazy. For sure it's a good practice to shut it off.