Mineral oil is a petroleum byproduct and will cause rubber to swell like brake fluid will do. The brake fluid will dissolve any paint that it comes in contact with. Pam is an oily material that will attract lots of dust and little bits of grit.
I would use a dry silicone spray that will not react with the rubber in the seals and not attract dirt and grit. 303 Protectant should also work. Armorall I think is also a petroleum product.
Is it possible someone has already lubed the seals with a petroleum based lube and causing the seals to swell and make noise?