9 Commits

Author	SHA1	Message	Date
Awni Hannun	c4230747a1	redesign for faster cpu/gpu synch (#1869) ... * redesign for faster cpu/gpu synch * load + more async CPU * use command encoder API and move more ops to use it * make fence back-end generic + CPU only fence * faster build * fix async eval * fixes + handle temporaries * fix / improve cpu conv * remove unused status, fix siblings * fix extensions * fix * fix no cpu build * format * comments * fix perf regression, remove unecessary abort * fix events, task limit cpu * fix waiting * fix donation / temporaries in normalization	2025-03-06 19:23:38 -08:00
Alex Barron	7f2d1024f3	add f8_e4m3 loading (#1859)	2025-02-13 17:10:03 -08:00
Awni Hannun	40c62c1321	Use int64 stride everywhere (#1671) ... * use int64 stride everywhere * fix ext * fix ext * more shape + cleanup * one more * few more	2024-12-09 11:09:02 -08:00
Awni Hannun	dcca0d7477	contiguous op / prim (#1612)	2024-11-21 19:51:49 -08:00
xnorai	16ec0556a0	Allocate raw JSON metadata buffer on the heap, and limit its size (#1596) ... * Allocate raw JSON metadata buffer on the heap, and limit its size to 1GiB * Set the upper size limit for the header to 100K as in Rust safetensors	2024-11-18 07:22:51 -08:00
Awni Hannun	020f048cd0	A few updates for CPU (#1482) ... * some updates * format * fix * nit	2024-10-14 12:45:49 -07:00
Awni Hannun	dba2bd1105	Even Even Faster IO (#1374) ... * even more faster io * make reader pool static * make python reader thread safe * one more optimization	2024-08-29 16:05:40 -07:00
Awni Hannun	fcb65a3897	Even Faster I/O (#1369) ... * try multithreading for faster IO * smaller batch size * Account for pread returning less than size * nit --------- Co-authored-by: Angelos Katharopoulos <a_katharopoulos@apple.com>	2024-08-28 11:49:07 -07:00
Awni Hannun	8b1906abd0	Add compiler flags to disable safetensors and gguf (#1098) ... * with docs * nit	2024-05-09 17:39:44 -07:00