mlx/python/mlx
Hazem Essam 37fc9db82c
Added Adafactor (#415)
* Added adafactor

* Added Adafactor and ran pre-commit

* modified operations

* Added docstrings

* Switched two ops to fix a bug

* added underscore for internal functions and removed the plus sign in the last return statment

* Removed parameter rms from the optimizer state because its not needed

* Added simple MNIST test for Adafactor and temporary training log

* remove test files

* nits in docs

* comment nit

---------

Co-authored-by: Awni Hannun <awni@apple.com>
2024-01-23 15:11:27 -08:00
..
nn Enable cross_entropy loss to handle dense targets (#517) 2024-01-23 12:17:22 -08:00
_reprlib_fix.py copyright + ack 2023-11-30 11:12:53 -08:00
extension.py Add isort pre-commit and run (#68) 2023-12-08 11:31:47 -08:00
optimizers.py Added Adafactor (#415) 2024-01-23 15:11:27 -08:00
utils.py Minor refactor for tree_map and tree_unflatten (#311) 2023-12-28 20:55:10 -08:00