2023-12-18 05:23:03 +08:00
|
|
|
.. _nn_functions:
|
|
|
|
|
|
|
|
|
|
.. currentmodule:: mlx.nn
|
|
|
|
|
|
|
|
|
|
Functions
|
|
|
|
|
---------
|
|
|
|
|
|
|
|
|
|
Layers without parameters (e.g. activation functions) are also provided as
|
|
|
|
|
simple functions.
|
|
|
|
|
|
|
|
|
|
.. autosummary::
|
|
|
|
|
:toctree: _autosummary_functions
|
|
|
|
|
:template: nn-module-template.rst
|
|
|
|
|
|
2024-03-01 04:39:18 +08:00
|
|
|
elu
|
2024-09-29 02:04:59 +08:00
|
|
|
celu
|
2023-12-18 05:23:03 +08:00
|
|
|
gelu
|
|
|
|
|
gelu_approx
|
|
|
|
|
gelu_fast_approx
|
2024-03-01 04:39:18 +08:00
|
|
|
glu
|
2024-06-07 11:28:06 +08:00
|
|
|
hard_shrink
|
|
|
|
|
hard_tanh
|
2024-03-01 04:39:18 +08:00
|
|
|
hardswish
|
|
|
|
|
leaky_relu
|
|
|
|
|
log_sigmoid
|
|
|
|
|
log_softmax
|
2024-01-18 09:15:29 +08:00
|
|
|
mish
|
2023-12-18 05:23:03 +08:00
|
|
|
prelu
|
2024-01-18 09:15:29 +08:00
|
|
|
relu
|
2024-03-01 04:39:18 +08:00
|
|
|
relu6
|
2024-01-18 09:15:29 +08:00
|
|
|
selu
|
2024-03-01 04:39:18 +08:00
|
|
|
sigmoid
|
2023-12-18 05:23:03 +08:00
|
|
|
silu
|
2024-03-01 04:39:18 +08:00
|
|
|
softmax
|
2024-06-07 11:28:06 +08:00
|
|
|
softmin
|
2024-03-01 04:39:18 +08:00
|
|
|
softplus
|
|
|
|
|
softshrink
|
2023-12-18 05:23:03 +08:00
|
|
|
step
|
2024-03-01 04:39:18 +08:00
|
|
|
tanh
|
