Light Switch with Dimmer Question

I just replaced all of our ceiling lights with LED bulbs, our original lights had the dimmer function so our switch has the dimmer control. My LEDs will turn on and then dim some which I do not want. ...