Hazem Essam 37fc9db82c Added Adafactor (#415) ...

* Added adafactor

* Added Adafactor and ran pre-commit

* modified operations

* Added docstrings

* Switched two ops to fix a bug

* added underscore for internal functions and removed the plus sign in the last return statment

* Removed parameter rms from the optimizer state because its not needed

* Added simple MNIST test for Adafactor and temporary training log

* remove test files

* nits in docs

* comment nit

---------

Co-authored-by: Awni Hannun <awni@apple.com>

2024-01-23 15:11:27 -08:00

..

mlx_tests.py

Primitive's VJP takes outputs as input (#475)

2024-01-16 19:03:53 -08:00

test_array.py

fix array from list for > 32 bit types (#501)

2024-01-19 15:49:25 -08:00

test_autograd.py

Power VJP fix for 0 (#505)

2024-01-20 01:17:40 -08:00

test_bf16.py

bump pre commit and fix format (#373)

2024-01-04 16:28:52 -08:00

test_blas.py

GGUF: Load and save metadata (#446)

2024-01-19 14:06:05 -08:00

test_constants.py

feat: Add numpy constants (#428)

2024-01-11 06:47:29 -08:00

test_conv.py

Add isort pre-commit and run (#68)

2023-12-08 11:31:47 -08:00

test_device.py

Add isort pre-commit and run (#68)

2023-12-08 11:31:47 -08:00

test_eval.py

Removes the retain_graph flag (#385)

2024-01-07 15:16:51 -08:00

test_fft.py

Add isort pre-commit and run (#68)

2023-12-08 11:31:47 -08:00

test_graph.py

Multi output primitives (#330)

2024-01-08 16:39:08 -08:00

test_init.py

Common neural network initializers nn.initializers (#456)

2024-01-23 06:47:20 -08:00

test_linalg.py

linalg.norm (#187)

2023-12-26 19:42:04 -08:00

test_load.py

GGUF: Load and save metadata (#446)

2024-01-19 14:06:05 -08:00

test_losses.py

Enable cross_entropy loss to handle dense targets (#517)

2024-01-23 12:17:22 -08:00

test_nn.py

feat: add support for saving safetensors in the save_weights (#497)

2024-01-19 06:19:33 -08:00

test_ops.py

use axes in tensordot (#525)

2024-01-22 21:17:00 -08:00

test_optimizers.py

Added Adafactor (#415)

2024-01-23 15:11:27 -08:00

test_quantized.py

Quantize with groups of 32 (#511)

2024-01-21 06:19:05 -08:00

test_random.py

make behaviour of dtype arguments consistent and compliant to numpy (#379)

2024-01-05 09:37:46 -08:00

test_reduce.py

bump pre commit and fix format (#373)

2024-01-04 16:28:52 -08:00

test_tree.py

Add isort pre-commit and run (#68)

2023-12-08 11:31:47 -08:00

test_vmap.py

feat: add logicalAnd and logicalOR (#386)

2024-01-08 07:00:05 -08:00