zhangyiss/mlx
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx.git synced 2025-09-29 01:58:12 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Shared events for synchronization + async eval (#998)

Browse Source 
* more async eval

* fix rebase

* try correct async eval

* fix async

* more tests for async eval

* use shared events for synchronization

* comment + cleanup

* with autorelease pool

* fix no metal build

* fix compile

* fix patch

* don't eval if asyn evale'd

* don't use is_evaled

* comments

* more multi stream tests

* try and cleanup use of is_evaled

* use a status flag
This commit is contained in:
Awni Hannun
2024-04-17 06:16:02 -07:00
committed by GitHub
parent b18468bf81
commit 8a0677d56d
28 changed files with 424 additions and 125 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
tests/metal_tests.cpp
View File

@@ -495,12 +495,14 @@ TEST_CASE("test metal memory info") {
// Query active and peak memory
{
auto a = zeros({4096});
// Do these tests on the CPU since deallocation is synchronized
// with the main thread.
auto a = zeros({4096}, Device::cpu);
eval(a);
auto active_mem = metal::get_active_memory();
CHECK(active_mem >= 4096 * 4);
{
auto b = zeros({4096});
auto b = zeros({4096}, Device::cpu);
eval(b);
}
auto new_active_mem = metal::get_active_memory();