zhangyiss/mlx
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx.git synced 2025-06-24 09:21:16 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

format

Browse Source
This commit is contained in:
Goekdeniz-Guelmez 2025-06-16 22:36:04 +02:00
parent 60cd4a5a6f
commit a426880baf
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
python/mlx/nn/layers/activations.py
View File

@ -136,9 +136,9 @@ def silu(x):
def clipped_silu(x, a_min=-100, a_max=100): def clipped_silu(x, a_min=-100, a_max=100):
r"""Applies the Clipped Sigmoid Linear Unit. r"""Applies the Clipped Sigmoid Linear Unit.
Applies :math:`\text{clip}(x \sigma(x), a\_min, a\_max)` element wise, where Applies :math:`\text{clip}(x \sigma(x), a\_min, a\_max)` element wise, where
:math:`\sigma(\cdot)` is the logistic sigmoid. :math:`\sigma(\cdot)` is the logistic sigmoid.
Args: Args:
a_min: minimum value for clipping. Default: ``-100`` a_min: minimum value for clipping. Default: ``-100``
a_max: maximum value for clipping. Default: ``100`` a_max: maximum value for clipping. Default: ``100``
@ -506,7 +506,7 @@ class ClippedSiLU(Module):
r"""Applies the Clipped Sigmoid Linear Unit. r"""Applies the Clipped Sigmoid Linear Unit.
See :func:`clipped_silu` for the functional equivalent. See :func:`clipped_silu` for the functional equivalent.
Args: Args:
a_min: minimum value for clipping. Default: ``-100`` a_min: minimum value for clipping. Default: ``-100``
a_max: maximum value for clipping. Default: ``100`` a_max: maximum value for clipping. Default: ``100``