The switch is either rated too low or there is an issue with the circuit it controls. Switching LED's in place of incandescent's may make the switch and circuit operable but doesn't forsee someone in the future switching the LED's back out for the originals and developing the same or worse problem. I'd suggest to check the amperage draw on the circuit and examine the switch for it's rating. My gut feeling is that you have a light circuit drawing current right at the ragged edge for what the switch is rated.