Awni Hannun ec72b44417 Add quantize/dequantize for mxfp8 and nvfp4 (#2688) ...

* Add quantize/dequantize slow path for mxfp8 and nvfp4

* fast cuda kernel for mx/nv quantization

* fallback for cuda < 12.8 (#2697)

* format (#2700)

* fix (#2701)

* metal kernels

* docs

* fix jit

* add default bits and group sizes

* improve quant docs

* fix output type of mxfp4 matmuls

2025-10-28 16:23:12 -07:00

..

__main__.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

cuda_skip.py

Add mode parameter for quantization (#2499)

2025-08-28 06:45:26 -07:00

mlx_distributed_tests.py

Distributed layers (#1270)

2025-03-21 13:52:17 -07:00

mlx_tests.py

Detect cache thrashing in LRUCache (#2600)

2025-09-19 09:12:14 +09:00

mpi_test_distributed.py

Fix the test and add custom min/max reductions for uncommon MPI types (#2060)

2025-04-10 17:01:17 -07:00

nccl_test_distributed.py

Remove stream from average grads so it uses default (#2532)

2025-08-25 15:56:29 -07:00

ring_test_distributed.py

fix all_gather vjp (#2654)

2025-10-07 06:05:23 -07:00

test_array.py

cuda fix flaky test (#2646)

2025-10-02 15:40:04 -07:00

test_autograd.py

cuda fix flaky test (#2646)

2025-10-02 15:40:04 -07:00

test_bf16.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_blas.py

fix addmm cpu (#2699)

2025-10-27 11:33:32 -07:00

test_compile.py

Export with callback (#2612)

2025-10-08 19:24:33 -07:00

test_constants.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_conv_transpose.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_conv.py

Fix overflow in large filter small channels (#2520)

2025-08-20 08:03:29 -07:00

test_device.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_double.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_einsum.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_eval.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_export_import.py

Export with callback (#2612)

2025-10-08 19:24:33 -07:00

test_fast_sdpa.py

avoid producing NaN in attention (#2608)

2025-09-22 13:10:43 -07:00

test_fast.py

Add batch offsets for mx.fast.rope (#2564)

2025-09-08 17:35:07 -07:00

test_fft.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_graph.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_init.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_linalg.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_load.py

add load with path tests (#2543)

2025-08-26 14:24:47 -07:00

test_losses.py

fix cross entropy axis param (#2641)

2025-10-01 16:49:55 -07:00

test_memory.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_nn.py

Add mode parameter for quantization (#2499)

2025-08-28 06:45:26 -07:00

test_ops.py

add median op (#2705)

2025-10-27 11:33:42 -07:00

test_optimizers.py

Adding support for the Muon Optimizer (#1914)

2025-07-18 12:25:28 -07:00

test_quantized.py

Add quantize/dequantize for mxfp8 and nvfp4 (#2688)

2025-10-28 16:23:12 -07:00

test_random.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_reduce.py

fix complex reduce + nan propagation in min and max (#2377)

2025-07-15 18:19:47 -07:00

test_tree.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_upsample.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00

test_vmap.py

add python testing for cuda with ability to skip list of tests (#2295)

2025-06-15 10:56:48 -07:00