10 Commits

Author	SHA1	Message	Date
Awni Hannun	70560b6bd5	Add mode parameter for quantization (#2499) ... * add mode parameter for quantization * mxfp4 quantize/dequantize + start of optional biases * mxfp4 works * speedup * cpu mxfp4 * fix * fix test tol * fix * refactor * add quant mode enum	2025-08-28 06:45:26 -07:00
Cheng	56cc858af9	Add contiguous_copy_cpu util for copying array (#2397)	2025-07-21 07:30:35 -07:00
Cheng	30571e2326	Rename the copy util in cpu/copy.h to copy_cpu (#2378)	2025-07-16 07:34:24 -07:00
Awni Hannun	6ef2f67e7f	5bit quants (#2226) ... * 5bit quants * 5bit quants	2025-05-30 12:12:10 -07:00
Awni Hannun	7b7e2352cd	fix malloc or wait deadlock (#1976)	2025-03-20 16:48:43 -07:00
Awni Hannun	736a340478	reduce binary size (#1952)	2025-03-11 06:30:44 -07:00
Awni Hannun	c4230747a1	redesign for faster cpu/gpu synch (#1869) ... * redesign for faster cpu/gpu synch * load + more async CPU * use command encoder API and move more ops to use it * make fence back-end generic + CPU only fence * faster build * fix async eval * fixes + handle temporaries * fix / improve cpu conv * remove unused status, fix siblings * fix extensions * fix * fix no cpu build * format * comments * fix perf regression, remove unecessary abort * fix events, task limit cpu * fix waiting * fix donation / temporaries in normalization	2025-03-06 19:23:38 -08:00
Alex Barron	fd0d63ba5b	Affine quant always in fp32 (#1925) ... * do affine quant in fp32 * static cast	2025-03-04 17:50:19 -08:00
Jesper Stemann Andersen	0ebc8a3d25	Fixed issue where Clang on FreeBSD failed to compile mlx/backend/cpu/quantized.cpp (#1890)	2025-02-20 12:02:12 -08:00
Awni Hannun	1156c84e86	Refactor common into cpu specific and truly common (#1817) ... * refactor * fix extension example * fix no-cpu	2025-02-03 15:58:02 -08:00