mlx/docs/build/doctrees/python/nn/_autosummary_functions/mlx.nn.gelu.doctree

<EFBFBD><05><00>sphinx.addnodes<65><73>document<6E><74><EFBFBD>)<29><>}<7D>(<28>	rawsource<63><65><00><>children<65>]<5D><>docutils.nodes<65><73>section<6F><6E><EFBFBD>)<29><>}<7D>(hhh]<5D>(h	<09>title<6C><65><EFBFBD>)<29><>}<7D>(h<05>mlx.nn.gelu<6C>h]<5D>h	<09>Text<78><74><EFBFBD><EFBFBD>mlx.nn.gelu<6C><75><EFBFBD><EFBFBD><EFBFBD>}<7D>(<28>parent<6E>h<11>	_document<6E>h<03>source<63>N<EFBFBD>line<6E>Nuba<62>
attributes<EFBFBD>}<7D>(<28>ids<64>]<5D><>classes<65>]<5D><>names<65>]<5D><>dupnames<65>]<5D><>backrefs<66>]<5D>u<EFBFBD>tagname<6D>hhhhhh<1D>U/Users/awnihannun/repos/mlx/docs/src/python/nn/_autosummary_functions/mlx.nn.gelu.rst<73>hKubh<00>index<65><78><EFBFBD>)<29><>}<7D>(hhh]<5D>h}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D><>entries<65>]<5D>(<28>single<6C><65>gelu (class in mlx.nn)<29><>mlx.nn.gelu<6C>hNt<4E>auh+h-hhhhh<1D>k/Users/awnihannun/repos/mlx/python/mlx/nn/layers/activations.py:docstring of mlx.nn.layers.activations.gelu<6C>hNubh<00>desc<73><63><EFBFBD>)<29><>}<7D>(hhh]<5D>(h<00>desc_signature<72><65><EFBFBD>)<29><>}<7D>(h<05>gelu(x)<29>h]<5D>(h<00>desc_annotation<6F><6E><EFBFBD>)<29><>}<7D>(h<05>2[<#text: 'class'>, <desc_sig_space: <#text: ' '>>]<5D>h]<5D>(h<16>class<73><73><EFBFBD><EFBFBD><EFBFBD>}<7D>(hhLhhhNhNubh<00>desc_sig_space<63><65><EFBFBD>)<29><>}<7D>(h<05>
 <20>h]<5D>h<16>
 <20><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hhVhhhNhNubah}<7D>(h!]<5D>h#]<5D><>
w<>ah%]<5D>h']<5D>h)]<5D>uh+hThhLubeh}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D><>	xml:space<63><65>preserve<76>uh+hJhhFhhh<1D>k/Users/awnihannun/repos/mlx/python/mlx/nn/layers/activations.py:docstring of mlx.nn.layers.activations.gelu<6C>hNubh<00>desc_addname<6D><65><EFBFBD>)<29><>}<7D>(h<05>mlx.nn.<2E>h]<5D>h<16>mlx.nn.<2E><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hhphhhNhNubah}<7D>(h!]<5D>h#]<5D>(<28>sig-prename<6D><65>
descclassname<6D>eh%]<5D>h']<5D>h)]<5D>hkhluh+hnhhFhhhhmhNubh<00>	desc_name<6D><65><EFBFBD>)<29><>}<7D>(h<05>gelu<6C>h]<5D>h<16>gelu<6C><75><EFBFBD><EFBFBD><EFBFBD>}<7D>(hh<>hhhNhNubah}<7D>(h!]<5D>h#]<5D>(<28>sig-name<6D><65>descname<6D>eh%]<5D>h']<5D>h)]<5D>hkhluh+h<>hhFhhhhmhNubh<00>desc_parameterlist<73><74><EFBFBD>)<29><>}<7D>(h<05>
x<>h]<5D>h<00>desc_parameter<65><72><EFBFBD>)<29><>}<7D>(h<05>
x<>h]<5D>h<00>
desc_sig_name<6D><65><EFBFBD>)<29><>}<7D>(h<05>
x<>h]<5D>h<16>
x<><78><EFBFBD><EFBFBD><EFBFBD>}<7D>(hh<>hhhNhNubah}<7D>(h!]<5D>h#]<5D><>
n<>ah%]<5D>h']<5D>h)]<5D>uh+h<>hh<>ubah}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D>hkhluh+h<>hh<>ubah}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D>hkhluh+h<>hhFhhhhmhNubeh}<7D>(h!]<5D>h<ah#]<5D>(<28>sig<69><67>
sig-object<63>eh%]<5D>h']<5D>h)]<5D><>module<6C><65>mlx.nn<6E><6E>class<73>h<06>fullname<6D>h<EFBFBD>uh+hDh<1D>k/Users/awnihannun/repos/mlx/python/mlx/nn/layers/activations.py:docstring of mlx.nn.layers.activations.gelu<6C>hK
hhAhhubh<00>desc_content<6E><74><EFBFBD>)<29><>}<7D>(hhh]<5D>(h	<09>	paragraph<70><68><EFBFBD>)<29><>}<7D>(h<05>1Applies the Gaussian Error Linear Units function.<2E>h]<5D>h<16>1Applies the Gaussian Error Linear Units function.<2E><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hh<>hhhNhNubah}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D>uh+h<>hh>hK
hh<>hhubh	<09>
math_block<EFBFBD><EFBFBD><EFBFBD>)<29><>}<7D>(h<05>!\\textrm{GELU}(x) = x * \Phi(x)

<EFBFBD>h]<5D>h<16>!\\textrm{GELU}(x) = x * \Phi(x)

<EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>}<7D>hh<>sbah}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D><>docname<6D><65>,python/nn/_autosummary_functions/mlx.nn.gelu<6C><75>number<65>N<EFBFBD>label<65>N<EFBFBD>nowrap<61><70>hkhluh+h<>hh>hKhh<>hhubh<62>)<29><>}<7D>(h<05>*where :math:`\Phi(x)` is the Gaussian CDF.<2E>h]<5D>(h<16>where <20><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hh<>hhhNhNubh	<09>math<74><68><EFBFBD>)<29><>}<7D>(h<05>:math:`\Phi(x)`<60>h]<5D>h<16>\Phi(x)<29><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hh<>hhhNhNubah}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D>uh+h<>hh<>ubh<16> is the Gaussian CDF.<2E><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hh<>hhhNhNubeh}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D>uh+h<>hh>hKhh<>hhubh<62>)<29><>}<7D>(h<05>TSee also :func:`gelu_approx` and :func:`gelu_fast_approx` for faster
approximations.<2E>h]<5D>(h<16>	See also <20><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hj
hhhNhNubh<00>pending_xref<65><66><EFBFBD>)<29><>}<7D>(h<05>:func:`gelu_approx`<60>h]<5D>h	<09>literal<61><6C><EFBFBD>)<29><>}<7D>(hj 
h]<5D>h<16>
gelu_approx()<29><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hj$
hhhNhNubah}<7D>(h!]<5D>h#]<5D>(<28>xref<65><66>py<70><79>py-func<6E>eh%]<5D>h']<5D>h)]<5D>uh+j"
hj
ubah}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D><>refdoc<6F>h<EFBFBD><68>	refdomain<69>j/
<00>reftype<70><65>func<6E><63>refexplicit<69><74><EFBFBD>refwarn<72><6E><EFBFBD>	py:module<6C>hČpy:class<73>h<EFBFBD><68>	reftarget<65><74>gelu_approx<6F>uh+j
hh>hKhj
ubh<16> and <20><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hj
hhhNhNubj
)<29><>}<7D>(h<05>:func:`gelu_fast_approx`<60>h]<5D>j#
)<29><>}<7D>(hjJ
h]<5D>h<16>gelu_fast_approx()<29><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hjL
hhhNhNubah}<7D>(h!]<5D>h#]<5D>(j.
<00>py<70><79>py-func<6E>eh%]<5D>h']<5D>h)]<5D>uh+j"
hjH
ubah}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D><>refdoc<6F>h<EFBFBD><68>	refdomain<69>jV
<00>reftype<70><65>func<6E><63>refexplicit<69><74><EFBFBD>refwarn<72><6E>j@
h<>jA
h<>jB
<00>gelu_fast_approx<6F>uh+j
hh>hKhj
ubh<16> for faster
approximations.<2E><><EFBFBD><EFBFBD><EFBFBD>}<7D>(hj
hhhNhNubeh}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D>uh+h<>hh>hKhh<>hhubeh}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D>uh+h<>hhAhhhhmhNubeh}<7D>(h!]<5D>h#]<5D>(<28>py<70><79>class<73>eh%]<5D>h']<5D>h)]<5D><>domain<69>j{
<00>objtype<70>j|
<00>desctype<70>j|
<00>noindex<65><78>uh+h?hhhhhh>hNubeh}<7D>(h!]<5D><>mlx-nn-gelu<6C>ah#]<5D>h%]<5D><>mlx.nn.gelu<6C>ah']<5D>h)]<5D>uh+h
hhhhhh,hKubah}<7D>(h!]<5D>h#]<5D>h%]<5D>h']<5D>h)]<5D><>source<63>h,uh+h
<01>current_source<63>N<EFBFBD>current_line<6E>N<EFBFBD>settings<67><73>docutils.frontend<6E><64>Values<65><73><EFBFBD>)<29><>}<7D>(hN<>	generator<6F>N<EFBFBD>	datestamp<6D>N<EFBFBD>source_link<6E>N<EFBFBD>
source_url<EFBFBD>N<EFBFBD>
toc_backlinks<6B><73>entry<72><79>footnote_backlinks<6B>K
<01>
sectnum_xform<72>K
<01>strip_comments<74>N<EFBFBD>strip_elements_with_classes<65>N<EFBFBD>
strip_classes<65>N<EFBFBD>report_level<65>K<02>
halt_level<EFBFBD>K<05>exit_status_level<65>K<05>debug<75>N<EFBFBD>warning_stream<61>N<EFBFBD>	traceback<63><6B><EFBFBD>input_encoding<6E><67>	utf-8-sig<69><67>input_encoding_error_handler<65><72>strict<63><74>output_encoding<6E><67>utf-8<><38>output_encoding_error_handler<65>j<EFBFBD>
<00>error_encoding<6E><67>utf-8<><38>error_encoding_error_handler<65><72>backslashreplace<63><65>
language_code<64><65>en<65><6E>record_dependencies<65>N<EFBFBD>config<69>N<EFBFBD>	id_prefix<69>h<06>auto_id_prefix<69><78>id<69><64>
dump_settings<67>N<EFBFBD>dump_internals<6C>N<EFBFBD>dump_transforms<6D>N<EFBFBD>dump_pseudo_xml<6D>N<EFBFBD>expose_internals<6C>N<EFBFBD>strict_visitor<6F>N<EFBFBD>_disable_config<69>N<EFBFBD>_source<63>h,<2C>_destination<6F>N<EFBFBD>
_config_files<65>]<5D><>file_insertion_enabled<65><64><EFBFBD>raw_enabled<65>K
<01>line_length_limit<69>M'<27>pep_references<65>N<EFBFBD>pep_base_url<72><6C>https://peps.python.org/<2F><>pep_file_url_template<74><65>pep-%04d<34><64>rfc_references<65>N<EFBFBD>rfc_base_url<72><6C>&https://datatracker.ietf.org/doc/html/<2F><>	tab_width<74>K<08>trim_footnote_reference_space<63><65><EFBFBD>syntax_highlight<68><74>long<6E><67>smart_quotes<65><73><EFBFBD>smartquotes_locales<65>]<5D><>character_level_inline_markup<75><70><EFBFBD>doctitle_xform<72><6D><EFBFBD>
docinfo_xform<72>K
<01>sectsubtitle_xform<72><6D><EFBFBD>
image_loading<6E><67>link<6E><6B>embed_stylesheet<65><74><EFBFBD>cloak_email_addresses<65><73><EFBFBD>section_self_link<6E><6B><EFBFBD>env<6E>Nub<75>reporter<65>N<EFBFBD>indirect_targets<74>]<5D><>substitution_defs<66>}<7D><>substitution_names<65>}<7D><>refnames<65>}<7D><>refids<64>}<7D><>nameids<64>}<7D>j<EFBFBD>
j<>
s<>	nametypes<65>}<7D>j<EFBFBD>
<00>sh!}<7D>(j<>
hh<hFu<46>
footnote_refs<66>}<7D><>
citation_refs<66>}<7D><>
autofootnotes<65>]<5D><>autofootnote_refs<66>]<5D><>symbol_footnotes<65>]<5D><>symbol_footnote_refs<66>]<5D><>	footnotes<65>]<5D><>	citations<6E>]<5D><>autofootnote_start<72>K
<01>symbol_footnote_start<72>K<00>
id_counter<EFBFBD><EFBFBD>collections<6E><73>Counter<65><72><EFBFBD>}<7D><><EFBFBD>R<EFBFBD><52>parse_messages<65>]<5D><>transform_messages<65>]<5D><>transformer<65>N<EFBFBD>include_log<6F>]<5D><>
decoration<EFBFBD>Nhhub.