docs/src/python/optimizers/schedulers.rst

.. _schedulers:

Schedulers
==========

.. currentmodule:: mlx.optimizers

.. autosummary::
   :toctree: _autosummary

   cosine_decay    
   exponential_decay    
   join_schedules
   linear_schedule
   step_decay
Support LR schedulers (#334) * Add a few LR schedulers * Move parents's constructor call to the top * Fix docstring * refactor optimizers into two files * add docs * nit * Fix Callable type annotation for python 3.8 --------- Co-authored-by: Awni Hannun <awni@apple.com> Co-authored-by: Angelos Katharopoulos <a_katharopoulos@apple.com> 2024-02-15 20:26:20 +01:00			`.. _schedulers:`

			`Schedulers`
			`==========`

			`.. currentmodule:: mlx.optimizers`

			`.. autosummary::`
			`:toctree: _autosummary`

			`cosine_decay`
Add linear warmup and schedule joining for use with existing schedules (#721) * Add linear warmup to schedules for use with existing schedules * Changed parameters for simplicity of most common case (0 initial value) * Added ScheduleJoiner and updated documentation * ScheduleJoiner -> join_schedules (ala optax #) * black compliance * Different evaluation of schedules * nits --------- Co-authored-by: Awni Hannun <awni@apple.com> 2024-02-26 10:28:48 -05:00			`exponential_decay`
			`join_schedules`
			`linear_schedule`
			`step_decay`