mlx/python
Hazem Essam 37fc9db82c
Added Adafactor (#415)
* Added adafactor

* Added Adafactor and ran pre-commit

* modified operations

* Added docstrings

* Switched two ops to fix a bug

* added underscore for internal functions and removed the plus sign in the last return statment

* Removed parameter rms from the optimizer state because its not needed

* Added simple MNIST test for Adafactor and temporary training log

* remove test files

* nits in docs

* comment nit

---------

Co-authored-by: Awni Hannun <awni@apple.com>
2024-01-23 15:11:27 -08:00
..
mlx Added Adafactor (#415) 2024-01-23 15:11:27 -08:00
src use axes in tensordot (#525) 2024-01-22 21:17:00 -08:00
tests Added Adafactor (#415) 2024-01-23 15:11:27 -08:00