9 Commits

Author	SHA1	Message	Date
Awni Hannun	58ccbaaf12	Use async cuda malloc managed with cuda 13	2025-10-27 16:18:40 -07:00
Cheng	4822c3dbe9	[CUDA] Implement DynamicSlice/DynamicSliceUpdate (#2533) ... * Move DynamicSlice to gpu/primitives * Implement compute_dynamic_offset in CUDA	2025-08-26 07:31:39 +09:00
Angelos Katharopoulos	e397177f6e	Custom cuda kernel (#2517)	2025-08-20 17:20:22 -07:00
Cheng	828c5f1137	Use SmallVector for shapes and strides (#2454) ... * Use SmallVector for shapes and strides * Convert SmallVector to tuple	2025-08-05 09:41:03 +09:00
Angelos Katharopoulos	be9bc96da4	[CUDA] Matmul utils initial commit (#2441)	2025-08-01 14:22:25 -07:00
Cheng	254476718b	Remove the kernel arg from get_launch_args (#2437)	2025-07-30 11:43:02 +09:00
Awni Hannun	ec0d5db67b	[CUDA] Switch to CUDA graphs (#2317) ... * cuda graph prototype fix signal bug + start to add dependencies capture more capture more ops remaining ops fix reduce and rope deps add concurrent context try update, but not working cosistent topology order use node api use node api directly to reduce overhead fix bug use kernels in unary cache graph format fix synchronization format * comment	2025-07-02 15:59:13 -07:00
Awni Hannun	bc53f8293f	Cuda bug fixes 2 (#2298) ... * more bug fixes * more bug fixes * format	2025-06-16 13:14:46 -07:00
Cheng	c8b4787e4e	CUDA backend: indexing ops (#2277)	2025-06-12 21:44:19 -07:00