mlx/docs/src/python/nn/layers.rst

.. _layers:

.. currentmodule:: mlx.nn

Layers
------

.. autosummary::
   :toctree: _autosummary
   :template: nn-module-template.rst

   Sequential
   ReLU
   PReLU
   GELU
   SiLU
   Step
   SELU
   Mish
   Embedding
   Linear
   QuantizedLinear
   Conv1d
   Conv2d
   BatchNorm
   LayerNorm
   RMSNorm
   GroupNorm
   Dropout
   Dropout2d
   Dropout3d
   Transformer
   MultiHeadAttention
   ALiBi
   RoPE
   SinusoidalPositionalEncoding
Docs updates (#198) Reorganize NN docs + a few other tidbits. 2023-12-18 05:20:55 +08:00			`.. _layers:`

			`.. currentmodule:: mlx.nn`

			`Layers`
			`------`

			`.. autosummary::`
			`:toctree: _autosummary`
			`:template: nn-module-template.rst`

Transformer fix (#167) * add transformer with dropout, fix transformer ffm, layernorm order * precommit changes * precommit changes * add docstring, activation, norm_first * run precommit * run precommit * add doctstring * precommit * style nits in docs --------- Co-authored-by: junwoo-yun <junwoo.yun@bagelcode.com> Co-authored-by: Awni Hannun <awni@apple.com> 2023-12-28 00:48:36 +08:00			`Sequential`
Docs updates (#198) Reorganize NN docs + a few other tidbits. 2023-12-18 05:20:55 +08:00			`ReLU`
			`PReLU`
			`GELU`
			`SiLU`
			`Step`
			`SELU`
			`Mish`
Transformer fix (#167) * add transformer with dropout, fix transformer ffm, layernorm order * precommit changes * precommit changes * add docstring, activation, norm_first * run precommit * run precommit * add doctstring * precommit * style nits in docs --------- Co-authored-by: junwoo-yun <junwoo.yun@bagelcode.com> Co-authored-by: Awni Hannun <awni@apple.com> 2023-12-28 00:48:36 +08:00			`Embedding`
Docs updates (#198) Reorganize NN docs + a few other tidbits. 2023-12-18 05:20:55 +08:00			`Linear`
Transformer fix (#167) * add transformer with dropout, fix transformer ffm, layernorm order * precommit changes * precommit changes * add docstring, activation, norm_first * run precommit * run precommit * add doctstring * precommit * style nits in docs --------- Co-authored-by: junwoo-yun <junwoo.yun@bagelcode.com> Co-authored-by: Awni Hannun <awni@apple.com> 2023-12-28 00:48:36 +08:00			`QuantizedLinear`
Docs updates (#198) Reorganize NN docs + a few other tidbits. 2023-12-18 05:20:55 +08:00			`Conv1d`
			`Conv2d`
implement-batch-norm-layer (#217) - Add batch normalization layer --------- Co-authored-by: Robert McCraith <mccraithrobert@gmail.com> Co-authored-by: Awni Hannun <awni@apple.com> 2023-12-25 23:32:53 +08:00			`BatchNorm`
Docs updates (#198) Reorganize NN docs + a few other tidbits. 2023-12-18 05:20:55 +08:00			`LayerNorm`
			`RMSNorm`
			`GroupNorm`
Add dropout2d (#250) 2023-12-23 00:02:29 +08:00			`Dropout`
			`Dropout2d`
feat: Add Dropout3d layer to nn.layers (#313) * feat: Add Dropout3d layer to nn.layers * acknowledgement * Add dropout tests to test_nn.py * run pre-commit * Add activation functions and dropout3d ops * Add dropout tests for bfloat16 and float16 2024-01-01 06:01:21 +08:00			`Dropout3d`
Transformer fix (#167) * add transformer with dropout, fix transformer ffm, layernorm order * precommit changes * precommit changes * add docstring, activation, norm_first * run precommit * run precommit * add doctstring * precommit * style nits in docs --------- Co-authored-by: junwoo-yun <junwoo.yun@bagelcode.com> Co-authored-by: Awni Hannun <awni@apple.com> 2023-12-28 00:48:36 +08:00			`Transformer`
			`MultiHeadAttention`
			`ALiBi`
			`RoPE`
			`SinusoidalPositionalEncoding`