4 Commits

Author	SHA1	Message	Date
Hazem Essam	37fc9db82c	Added Adafactor (#415) ... * Added adafactor * Added Adafactor and ran pre-commit * modified operations * Added docstrings * Switched two ops to fix a bug * added underscore for internal functions and removed the plus sign in the last return statment * Removed parameter rms from the optimizer state because its not needed * Added simple MNIST test for Adafactor and temporary training log * remove test files * nits in docs * comment nit --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-01-23 15:11:27 -08:00
Justin Deschenaux	4912ff3ec2	Add Lion optimizer (#209) ... * Add Lion optimizer * Update acknowledgements also with past contributions	2023-12-20 13:54:58 -08:00
YUN, Junwoo	eebd7c275d	Add optimizers (AdaMax, AdaDelta, RMSprop) and ordering optimizer classes (#142) ... * Add AdaMax, AdaDelta, RMSprop	2023-12-16 21:43:15 -08:00
Awni Hannun	8ca7f9e8e9	awni's commit files	2023-11-29 10:30:41 -08:00