Water Pump runs regardless of panel switch position.

So this is an odd one for me but thought I would see if it's ever happened to others. Our water pump runs whether or not the water pump switch is on or off. To be clear: I am not saying the pump runs continuously. It only runs on demand like it should. However it used to require that we had the W/P control panel switch 'on' for it to operate. Almost as if the switch has fused the link within itself.
Any thoughts? Am I over thinking this and should just remove the panel and replace the switch? (Just typing this is making me want to go try) ;)