This may be due to a couple of reasons:
Your LED bulbs may not be dimmable. Not all LED light bulbs have the ability to dim so you must make sure that your bulbs are the dimmable type.
Ensure that you have an LED-compatible dimmer switch. Standard household dimmer switches do not work with LED bulbs. Dimmable LED bulbs will only operate effectively with an LED dimmer switch.