Add Lion optimizer (#209)

* Add Lion optimizer
* Update acknowledgements also with past contributions
This commit is contained in:
Justin Deschenaux
2023-12-20 22:54:58 +01:00
committed by GitHub
parent f40d17047d
commit 4912ff3ec2
3 changed files with 59 additions and 1 deletions

View File

@@ -44,3 +44,4 @@ model's parameters and the **optimizer state**.
Adam
AdamW
Adamax
Lion