mlx/docs/src/python/optimizers/common_optimizers.rst

.. _common_optimizers:

Common Optimizers
=================

.. currentmodule:: mlx.optimizers

.. autosummary::
   :toctree: _autosummary
   :template: optimizers-template.rst

   SGD
   RMSprop
   Adagrad
   Adafactor
   AdaDelta
   Adam
   AdamW
   Adamax
   Lion
   MultiOptimizer
   Muon
Support LR schedulers (#334) * Add a few LR schedulers * Move parents's constructor call to the top * Fix docstring * refactor optimizers into two files * add docs * nit * Fix Callable type annotation for python 3.8 --------- Co-authored-by: Awni Hannun <awni@apple.com> Co-authored-by: Angelos Katharopoulos <a_katharopoulos@apple.com> 2024-02-15 20:26:20 +01:00			`.. _common_optimizers:`

			`Common Optimizers`
			`=================`

			`.. currentmodule:: mlx.optimizers`

			`.. autosummary::`
			`:toctree: _autosummary`
			`:template: optimizers-template.rst`

			`SGD`
			`RMSprop`
			`Adagrad`
			`Adafactor`
			`AdaDelta`
			`Adam`
			`AdamW`
			`Adamax`
			`Lion`
Fix stubgen (#2065) * Fix stubgen * add multi optim to docs 2025-04-11 12:02:54 -07:00			`MultiOptimizer`
Adding support for the Muon Optimizer (#1914) * initial commit with workong optmimizer * update ACKNOWLEDGMENTS.md * nits and adding it to test * nits * G.astype(mx.bfloat16) to G.astype(G.dtype) * G.ndim >= 2 to assert G.ndim == 2 * remove coments * replace with mx.addmm * remove comments * format * nits * match muon * fix addmm --------- Co-authored-by: Awni Hannun <awni@apple.com> 2025-07-18 21:25:28 +02:00			`Muon`