zhangyiss/mlx
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx.git synced 2025-07-20 08:01:12 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Add tanh activation function (#115)

Browse Source 
* added Adagrad optimizer ...

* added Tanh activation function ...

* reformatted file ...

* remove unrelated stuff ...

* Update activations.py
This commit is contained in:
__mo_san__ 2023-12-10 04:25:38 +01:00 committed by GitHub
parent 0b28399638
commit ef7b8756c0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 13 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
python/mlx/nn/layers/activations.py
View File

@ -129,3 +129,16 @@ class GELU(Module):
def __call__(self, x): def __call__(self, x):
return self._act(x) return self._act(x)
def tanh(x):
"""Applies the hyperbolic tangent function.
Simply ``mx.tanh(x)``.
"""
return mx.tanh(x)
@_make_activation_module(tanh)
class Tanh(Module):
pass