mlx.nn.SiLU

class mlx.nn.SiLU

Applies the Sigmoid Linear Unit.

Applies \(x \sigma(x)\) element wise, where \(\sigma(\cdot)\) is the logistic sigmoid.