Awni Hannun 70560b6bd5 Add mode parameter for quantization (#2499) ...

* add mode parameter for quantization

* mxfp4 quantize/dequantize + start of optional biases

* mxfp4 works

* speedup

* cpu mxfp4

* fix

* fix test tol

* fix

* refactor

* add quant mode enum

2025-08-28 06:45:26 -07:00

..

gemms

add a half simd gemm fallback (#2046)

2025-04-07 09:31:29 -07:00

simd

fix power (#2523)

2025-08-21 06:46:01 -07:00

arange.h

redesign for faster cpu/gpu synch (#1869)

2025-03-06 19:23:38 -08:00

arg_reduce.cpp

Add remove_index utility (#2173)

2025-05-13 17:09:56 -07:00

available.cpp

Generalize gpu backend (#2138)

2025-04-30 09:08:17 -07:00

available.h

Generalize gpu backend (#2138)

2025-04-30 09:08:17 -07:00

binary_ops.h

Refactor common into cpu specific and truly common (#1817)

2025-02-03 15:58:02 -08:00

binary_two.h

reduce binary size (#1952)

2025-03-11 06:30:44 -07:00

binary.cpp

Complex scan (#2094)

2025-04-22 18:56:28 -07:00

binary.h

reduce binary size (#1952)

2025-03-11 06:30:44 -07:00

cholesky.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

CMakeLists.txt

non-symmetric eig and eigh (#2188)

2025-05-15 13:01:44 -07:00

compiled_preamble.h

Refactor common into cpu specific and truly common (#1817)

2025-02-03 15:58:02 -08:00

compiled.cpp

Separate cpu compilation cache by versions (#2548)

2025-08-27 11:25:15 +09:00

conv.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

copy.cpp

Add contiguous_copy_cpu util for copying array (#2397)

2025-07-21 07:30:35 -07:00

copy.h

Add contiguous_copy_cpu util for copying array (#2397)

2025-07-21 07:30:35 -07:00

distributed.cpp

Add contiguous_copy_cpu util for copying array (#2397)

2025-07-21 07:30:35 -07:00

eig.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

eigh.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

encoder.cpp

redesign for faster cpu/gpu synch (#1869)

2025-03-06 19:23:38 -08:00

encoder.h

Fix multistream GPU deadlock (#1969)

2025-03-20 07:19:47 -07:00

eval.cpp

Fix multistream GPU deadlock (#1969)

2025-03-20 07:19:47 -07:00

eval.h

redesign for faster cpu/gpu synch (#1869)

2025-03-06 19:23:38 -08:00

fft.cpp

fix malloc or wait deadlock (#1976)

2025-03-20 16:48:43 -07:00

gemm.h

redesign for faster cpu/gpu synch (#1869)

2025-03-06 19:23:38 -08:00

hadamard.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

indexing.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

inverse.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

jit_compiler.cpp

Add missing <algorithm> header to jit_compiler.cpp (#2460)

2025-08-04 14:00:46 -07:00

jit_compiler.h

Refactor common into cpu specific and truly common (#1817)

2025-02-03 15:58:02 -08:00

lapack.h

fix lapack svd (#2515)

2025-08-18 15:07:59 -07:00

logsumexp.cpp

Add contiguous_copy_cpu util for copying array (#2397)

2025-07-21 07:30:35 -07:00

luf.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

make_compiled_preamble.ps1

Refactor common into cpu specific and truly common (#1817)

2025-02-03 15:58:02 -08:00

make_compiled_preamble.sh

fix cpu compile (#1897)

2025-02-24 14:10:30 -08:00

masked_mm.cpp

Add contiguous_copy_cpu util for copying array (#2397)

2025-07-21 07:30:35 -07:00

matmul.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

primitives.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

qrf.cpp

Rename the copy util in cpu/copy.h to copy_cpu (#2378)

2025-07-16 07:34:24 -07:00

quantized.cpp

Add mode parameter for quantization (#2499)

2025-08-28 06:45:26 -07:00

reduce.cpp

Fix reduce sum/prod overflow (#2477)

2025-08-12 00:05:33 -07:00

scan.cpp

Add contiguous_copy_cpu util for copying array (#2397)

2025-07-21 07:30:35 -07:00

select.cpp

reduce binary size (#1952)

2025-03-11 06:30:44 -07:00

slicing.h

Refactor common into cpu specific and truly common (#1817)

2025-02-03 15:58:02 -08:00

softmax.cpp

Add contiguous_copy_cpu util for copying array (#2397)

2025-07-21 07:30:35 -07:00

sort.cpp

Use SmallVector for shapes and strides (#2454)

2025-08-05 09:41:03 +09:00

svd.cpp

fix lapack svd (#2515)

2025-08-18 15:07:59 -07:00

ternary.h

reduce binary size (#1952)

2025-03-11 06:30:44 -07:00

threefry.cpp

Refactor common into cpu specific and truly common (#1817)

2025-02-03 15:58:02 -08:00

threefry.h

Refactor common into cpu specific and truly common (#1817)

2025-02-03 15:58:02 -08:00

unary_ops.h

Fix CPU sign for unsigned ints (#2024)

2025-03-30 17:56:59 -07:00

unary.cpp

Fix MSVC build due to use of M_LN2 (#2058)

2025-04-10 07:41:41 -07:00

unary.h

CUDA backend: unary ops (#2158)

2025-06-09 06:45:08 -07:00