Nripesh Niketan 79c859e2e0 feat: implement clip_grad_norm (#1043) ...

* feat: implement `clip_grad_norm`

* pre-commit

* Add test for clip_grad_norm function in test_optimizers.py

* small fixes

* fix

* lint

* Update tree_reduce

* Update python/mlx/utils.py

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>

* Update python/mlx/utils.py

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>

* Update python/mlx/utils.py

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>

* Update python/mlx/utils.py

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>

* Update python/mlx/utils.py

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>

* Update python/mlx/utils.py

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>

* Refactor clip_grad_norm function to include documentation and improve readability

* format docstring

* Add acknowlegements

* text wrap

* pre-commit

* nits in docs

---------

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>
Co-authored-by: Awni Hannun <awni@apple.com>

2024-05-03 09:07:02 -07:00

..

mlx_tests.py

Make MLX build on x64 macOS (#901)

2024-03-27 06:14:29 -07:00

test_array.py

Fix leak for multi-output primitives which are never detached (#1059)

2024-05-01 07:31:45 -07:00

test_autograd.py

Fix logsumexp edge case (#740)

2024-02-25 08:39:55 -08:00

test_bf16.py

bump pre commit and fix format (#373)

2024-01-04 16:28:52 -08:00

test_blas.py

Block sparse mm (#1058)

2024-05-02 14:03:58 -07:00

test_compile.py

Fix compile fusion for multi-output edge cases (#950)

2024-04-02 08:42:31 -07:00

test_constants.py

feat: Add numpy constants (#428)

2024-01-11 06:47:29 -08:00

test_conv.py

Add groups to Conv1d (#948)

2024-04-27 06:24:57 -07:00

test_device.py

Adds device context manager (#679)

2024-02-14 14:14:58 -08:00

test_eval.py

Shared events for synchronization + async eval (#998)

2024-04-17 06:16:02 -07:00

test_fast_sdpa.py

Make MLX build on x64 macOS (#901)

2024-03-27 06:14:29 -07:00

test_fast.py

No copy command encoder (#986)

2024-04-11 21:15:36 -07:00

test_fft.py

Metal FFT for powers of 2 up to 2048 (#915)

2024-04-11 21:40:06 -07:00

test_graph.py

Multi output primitives (#330)

2024-01-08 16:39:08 -08:00

test_init.py

Make shape a tuple (#591)

2024-01-30 13:11:01 -08:00

test_linalg.py

Add matrix inversion primitive (#822)

2024-03-15 06:34:36 -07:00

test_load.py

Fix logsumexp edge case (#740)

2024-02-25 08:39:55 -08:00

test_losses.py

Feat: Add weights argument in BCE Loss and tests (#620)

2024-02-07 09:39:52 -08:00

test_metal.py

Expose function to clear memory cache (#1032)

2024-04-24 16:48:51 -07:00

test_nn.py

Make sure 0 is represented in the quantization (#1016)

2024-04-19 19:47:26 -07:00

test_ops.py

Add bitwise ops (#1037)

2024-04-26 22:03:42 -07:00

test_optimizers.py

feat: implement clip_grad_norm (#1043)

2024-05-03 09:07:02 -07:00

test_quantized.py

Improvements in the quantizer and dequantization kernel (#1061)

2024-05-01 18:19:11 -07:00

test_random.py

Implementation of mlx.random.multivariate_normal (#502) (#877)

2024-04-09 13:50:12 -07:00

test_reduce.py

Add GPU support for uint64/int64 reductions (#569)

2024-01-31 11:18:04 -08:00

test_tree.py

Add isort pre-commit and run (#68)

2023-12-08 11:31:47 -08:00

test_upsample.py

Upsample with bicubic interpolation (#967)

2024-04-10 15:47:22 -07:00

test_vmap.py

Adds radians and degrees (#1011)

2024-04-22 11:17:49 -07:00