mlx.nn.gelu
- class mlx.nn.gelu(x)
Applies the Gaussian Error Linear Units function.
\[\textrm{GELU}(x) = x * \Phi(x)\]where \(\Phi(x)\) is the Gaussian CDF.
See also
gelu_approx()andgelu_fast_approx()for faster approximations.
Applies the Gaussian Error Linear Units function.
where \(\Phi(x)\) is the Gaussian CDF.
See also gelu_approx() and gelu_fast_approx() for faster
approximations.