Angelos Katharopoulos ca7970a4f1 Make args references but ensure copy to kernel

2025-10-02 11:39:21 -07:00

..

binary

Faster general unary op (#2472)

2025-08-15 15:04:12 -07:00

conv

[CUDA] Add GEMM-based fallback convolution kernels (#2511)

2025-08-20 10:06:22 +09:00

copy

Faster general unary op (#2472)

2025-08-15 15:04:12 -07:00

device

[CUDA] Remove thrust in arange (#2535)

2025-08-24 16:22:36 +09:00

gemms

[CUDA] Set bias as input when using bias epilogue (#2584)

2025-09-11 15:31:09 +09:00

quantized

Add mode parameter for quantization (#2499)

2025-08-28 06:45:26 -07:00

reduce

Make args references but ensure copy to kernel

2025-10-02 11:39:21 -07:00

steel

[CUDA] Matmul utils initial commit (#2441)

2025-08-01 14:22:25 -07:00

unary

Faster general unary op (#2472)

2025-08-15 15:04:12 -07:00

allocator.cpp

wait for tasks in cuda (#2636)

2025-09-30 16:08:46 -07:00

allocator.h

[CUDA] Simplify allocator (#2392)

2025-07-22 08:24:01 -07:00

arange.cu

[CUDA] Remove thrust in arange (#2535)

2025-08-24 16:22:36 +09:00

arg_reduce.cu

[CUDA] Matmul utils initial commit (#2441)

2025-08-01 14:22:25 -07:00

bin2h.cmake

CUDA backend: compile (#2276)

2025-06-12 17:08:39 -07:00

binary_two.cu

Faster general unary op (#2472)

2025-08-15 15:04:12 -07:00

CMakeLists.txt

NCCL backend (#2476)

2025-08-21 11:56:15 -07:00

compiled.cpp

fix for max block dim (#2631)

2025-09-29 08:59:25 -07:00

conv.cpp

Detect cache thrashing in LRUCache (#2600)

2025-09-19 09:12:14 +09:00

copy.cu

[CUDA] Implement DynamicSlice/DynamicSliceUpdate (#2533)

2025-08-26 07:31:39 +09:00

cuda.cpp

start cuda circle config (#2256)

2025-06-10 21:19:47 -07:00

cuda.h

start cuda circle config (#2256)

2025-06-10 21:19:47 -07:00

cudnn_utils.cpp

[CUDA] Fix stride of singleton dims before passing to cuDNN (#2521)

2025-08-21 08:55:26 +09:00

cudnn_utils.h

Split cuDNN helpers into a separate header (#2491)

2025-08-20 09:29:28 +09:00

custom_kernel.cpp

Custom cuda kernel (#2517)

2025-08-20 17:20:22 -07:00

device.cpp

wait for tasks in cuda (#2636)

2025-09-30 16:08:46 -07:00

device.h

wait for tasks in cuda (#2636)

2025-09-30 16:08:46 -07:00

distributed.cu

Fix allocation bug in NCCL (#2530)

2025-08-22 14:39:43 -07:00

eval.cpp

wait for tasks in cuda (#2636)

2025-09-30 16:08:46 -07:00

event.cu

[CUDA] Make CudaEvent work with multi-device (#2614)

2025-09-27 11:27:17 +09:00

event.h

[CUDA] Make CudaEvent work with multi-device (#2614)

2025-09-27 11:27:17 +09:00

fence.cpp

[CUDA] Recycle CUDA events (#2604)

2025-09-23 10:42:03 +09:00

indexing.cpp

[CUDA] Implement DynamicSlice/DynamicSliceUpdate (#2533)

2025-08-26 07:31:39 +09:00

jit_module.cpp

fix for max block dim (#2631)

2025-09-29 08:59:25 -07:00

jit_module.h

fix for max block dim (#2631)

2025-09-29 08:59:25 -07:00

kernel_utils.cu

fix for max block dim (#2631)

2025-09-29 08:59:25 -07:00

kernel_utils.cuh

fix for max block dim (#2631)

2025-09-29 08:59:25 -07:00

layer_norm.cu

[CUDA] Matmul utils initial commit (#2441)

2025-08-01 14:22:25 -07:00

logsumexp.cu

[CUDA] Matmul utils initial commit (#2441)

2025-08-01 14:22:25 -07:00

lru_cache.h

Detect cache thrashing in LRUCache (#2600)

2025-09-19 09:12:14 +09:00

matmul.cpp

[CUDA] Set bias as input when using bias epilogue (#2584)

2025-09-11 15:31:09 +09:00

no_cuda.cpp

Custom cuda kernel (#2517)

2025-08-20 17:20:22 -07:00

primitives.cpp

[CUDA] Implement DynamicSlice/DynamicSliceUpdate (#2533)

2025-08-26 07:31:39 +09:00

random.cu

[CUDA] Matmul utils initial commit (#2441)

2025-08-01 14:22:25 -07:00

reduce.cu

faster rms norm (#2433)

2025-07-29 13:12:00 -07:00

rms_norm.cu

[CUDA] Matmul utils initial commit (#2441)

2025-08-01 14:22:25 -07:00

rope.cu

Add batch offsets for mx.fast.rope (#2564)

2025-09-08 17:35:07 -07:00

scaled_dot_product_attention.cu

avoid producing NaN in attention (#2608)

2025-09-22 13:10:43 -07:00

scan.cu

[CUDA] Matmul utils initial commit (#2441)

2025-08-01 14:22:25 -07:00

slicing.cpp

[CUDA] Use ConcurrentContext in concatenate_gpu (#2549)

2025-08-28 09:30:08 +09:00

softmax.cu

[CUDA] Matmul utils initial commit (#2441)

2025-08-01 14:22:25 -07:00

sort.cu

[CUDA] fix sort (#2550)

2025-08-27 19:48:43 -07:00

ternary.cu

Faster general unary op (#2472)

2025-08-15 15:04:12 -07:00

unary.cu

Faster general unary op (#2472)

2025-08-15 15:04:12 -07:00

utils.cpp

Split cuDNN helpers into a separate header (#2491)

2025-08-20 09:29:28 +09:00

utils.h

fix for max block dim (#2631)

2025-09-29 08:59:25 -07:00

worker.cpp

[CUDA] Make CudaEvent work with multi-device (#2614)

2025-09-27 11:27:17 +09:00

worker.h

[CUDA] Make CudaEvent work with multi-device (#2614)

2025-09-27 11:27:17 +09:00