20 Commits

Author	SHA1	Message	Date
Cheng	d34f887abc	Add Primitive::name and remove Primitive::print (#2365)	2025-07-14 14:06:35 -07:00
Awni Hannun	c6a20b427a	Improve metal elementwise kernels (#2247) ... * improve metal elementwise kernels * compile and copy * fix jit	2025-06-06 11:37:40 -07:00
Awni Hannun	825124af8f	fix bw for elementwise ops (#2151) ... * fix bw for elementwise ops * add compile * fix * fix * fix * fix	2025-05-05 06:15:04 -07:00
Awni Hannun	c4230747a1	redesign for faster cpu/gpu synch (#1869) ... * redesign for faster cpu/gpu synch * load + more async CPU * use command encoder API and move more ops to use it * make fence back-end generic + CPU only fence * faster build * fix async eval * fixes + handle temporaries * fix / improve cpu conv * remove unused status, fix siblings * fix extensions * fix * fix no cpu build * format * comments * fix perf regression, remove unecessary abort * fix events, task limit cpu * fix waiting * fix donation / temporaries in normalization	2025-03-06 19:23:38 -08:00
Awni Hannun	6bd28d246e	Allow no copy negative strides in as_strided and slice (#1688) ... * allow no copy negative strides in as_strided and slice * fix jit * fix jit	2024-12-12 08:59:45 -08:00
Awni Hannun	40c62c1321	Use int64 stride everywhere (#1671) ... * use int64 stride everywhere * fix ext * fix ext * more shape + cleanup * one more * few more	2024-12-09 11:09:02 -08:00
Awni Hannun	211411faf2	fix large ops (#1620)	2024-11-24 09:17:10 -08:00
Awni Hannun	2419edd5b2	Faster indexing math in a few kernels (#1589) ... * wip: faster compiled kernels * faster general unary with uint specialization * index type in compiled, unary, binary, ternary, copy * fix jit * jit fix * specialize gather + scatter * nit in docs	2024-11-18 19:52:00 -08:00
Awni Hannun	9f0d5c12fc	Fully wrap the command encoder (#1572) ... * fully wrap the command encoder * use consistent style + fix extensions	2024-11-08 11:50:21 -08:00
Awni Hannun	884af42da2	Fix thread group for large arrays (#1543) ... * fix thread group for large arrays * comment * one more	2024-10-30 16:25:12 -07:00
Awni Hannun	881615b072	Faster metal compiled kernels + some fixes (#1486) ... * bump mac tests to use py39 * work per thread for compiled kernels * fixe for large arrays * fix	2024-10-14 12:45:38 -07:00
Awni Hannun	5b6f38df2b	Faster cpu ops (#1434) ... * faster binary and cleaner copy * use recursive template for other ops * more cleanup * fix from cleanup * more clean * fix binary * use contiguous iterator * add 3d * nits * fix * fix? * fix * fix rebase	2024-09-26 09:19:13 -07:00
Awni Hannun	4f9f9ebb6f	Faster Metal unary and binary for general case (#1431) ... * faster unary and binary for general case * update ternary + jit fix * fix jit * unary work per thread	2024-09-25 12:07:43 -07:00
Awni Hannun	4f46e9c997	More fixes for arrays with large sizes (#1405) ... * compile works for big arrays when contiguous * style * nits in docs * a bunch more stuff * update jit * update jit * use constant for shapes and strides and remove elem_to_loc overload * use kernel instantiation * docs nits * update binary and ternary * comments	2024-09-17 12:46:31 -07:00
Awni Hannun	2fdf9eb535	Fix ternary for large arrays (#1359) ... * fix ternary for large arrays * fix	2024-08-26 11:22:27 -07:00
Awni Hannun	30bbea2f08	Add gemv masked to JIT plus some fixes (#1310) ... * add gemv masked to JIT plus some fixes * some cleanup * add utils * fix * fix 2 * more cleaning * fix * remove unused mps matmul support * one more nit * revert	2024-08-07 13:38:07 -07:00
Awni Hannun	40b6d67333	Fixes for large arrays with a few ops (#1299) ... * fixes for large arrays with a few ops * fix bug * fix all of copy	2024-07-30 17:18:39 -07:00
Alex Barron	934683088e	Refactor JIT for unary/binary/ternary ops (#1206) ... * refactor unary/binary/ternary ops * get_primitive_string util ---------	2024-06-12 14:22:12 -07:00
Alex Barron	375a8bbdcc	Add some internal GPU apis (#1177) ... * Add unary/binary/ternay/slice/concat internal GPU ops * add pad internal op * formatting + no_cpu fix	2024-06-04 09:24:26 -07:00
Awni Hannun	226748b3e7	JIT compile option for binary minimization (#1091) ... * try cpp 20 for compile * unary, binary, ternary in jit * nits * fix gather/scatter * fix rebase * reorg compile * add ternary to compile * jit copy * jit compile flag * fix build * use linked function for ternary * some nits * docs + circle min size build * docs + circle min size build * fix extension * fix no cpu build * improve includes	2024-05-22 12:57:13 -07:00