Hazem Essam 37fc9db82c Added Adafactor (#415) ...

* Added adafactor

* Added Adafactor and ran pre-commit

* modified operations

* Added docstrings

* Switched two ops to fix a bug

* added underscore for internal functions and removed the plus sign in the last return statment

* Removed parameter rms from the optimizer state because its not needed

* Added simple MNIST test for Adafactor and temporary training log

* remove test files

* nits in docs

* comment nit

---------

Co-authored-by: Awni Hannun <awni@apple.com>

2024-01-23 15:11:27 -08:00

..

nn

Enable cross_entropy loss to handle dense targets (#517)

2024-01-23 12:17:22 -08:00

_reprlib_fix.py

copyright + ack

2023-11-30 11:12:53 -08:00

extension.py

Add isort pre-commit and run (#68)

2023-12-08 11:31:47 -08:00

optimizers.py

Added Adafactor (#415)

2024-01-23 15:11:27 -08:00

utils.py

Minor refactor for tree_map and tree_unflatten (#311)

2023-12-28 20:55:10 -08:00