mlx.nn.Mish

class mlx.nn.Mish

Applies the Mish function, element-wise. Mish: A Self Regularized Non-Monotonic Neural Activation Function.

Reference: https://arxiv.org/abs/1908.08681

\[\text{Mish}(x) = x * \text{Tanh}(\text{Softplus}(x))\]