Turning Hot Water Heater On (Gas)

When we turn our hot water heater on w/Propane), it sounds like a small explosion out there. What could be causing this??