zhangyiss/mlx
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx.git synced 2025-12-16 01:49:05 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

[CUDA] Recycle CUDA events (#2604)

Browse Source 
* Make CudaEvent a CudaHandle

* Add caching for CudaEvent

* Make sure cuda events are destroyed at last

* Fix headers

* SharedEvent => AtomicEvent

* RawCudaEvent => CudaEventHandle, CudaEventWrapper => CopyableCudaEvent

* Remove unneeded asserts
This commit is contained in:
Cheng
2025-09-23 10:42:03 +09:00
committed by GitHub
parent 711a645807
commit ae438d05fa
6 changed files with 159 additions and 110 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
mlx/backend/cuda/fence.cpp
View File

@@ -7,7 +7,7 @@ namespace mlx::core {
struct FenceImpl {
uint32_t count;
cu::SharedEvent event;
cu::AtomicEvent event;
};
Fence::Fence(Stream s) {