6 Commits

Author	SHA1	Message	Date
Hazem Essam	37fc9db82c	Added Adafactor (#415) ... * Added adafactor * Added Adafactor and ran pre-commit * modified operations * Added docstrings * Switched two ops to fix a bug * added underscore for internal functions and removed the plus sign in the last return statment * Removed parameter rms from the optimizer state because its not needed * Added simple MNIST test for Adafactor and temporary training log * remove test files * nits in docs * comment nit --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-01-23 15:11:27 -08:00
Awni Hannun	89b90dcfec	Pr template (#99) ... * pr template * format fix	2023-12-09 09:36:56 -08:00
ShiJZ	08d51bf232	Make it easier to test new optimizers implemented: no need to change test file manually (#90) ... * add helper function get_all_optimizers() in test_optimizers.py * remove unused import	2023-12-08 21:39:08 -08:00
Zach Schillaci	5b9be57ac3	Add isort pre-commit and run (#68)	2023-12-08 11:31:47 -08:00
Awni Hannun	46a39e5b1f	copyright + ack	2023-11-30 11:12:53 -08:00
Jagrit Digani	e6306cfee9	jagrit's commit files	2023-11-29 10:52:08 -08:00