Atwood rv furnace only ignites if exhaust port plugged

Hello, I have a 97 RV with an atwood furnace #8531. Had dang mud dauber in exhaust port. Cleaned with air compressor, a few chunks of dirt came out. Pounded on exhaust pipes. Still will not ...