Schedulers

step_decay(init, decay_rate, step_size)	Make a step decay scheduler.
exponential_decay(init, decay_rate)	Make an exponential decay scheduler.
cosine_decay(init, decay_steps)	Make a cosine decay scheduler.