Anastasiia Filippova
|
27778156dc
|
Nccl reduce scatter, all gather (#2727)
* Added reduce scatter and all gather for nccl
* fix unused import, delete unused file
* small fix
* deleted useless condition
* fixed comments
* fix bug in eval_gpu, renamed to sum_scatter, fix docs
* final fix docs
* remove and
* Update mlx/distributed/mpi/mpi.cpp
Co-authored-by: Awni Hannun <awni.hannun@gmail.com>
* fix broken set input output
* fixes set output
* typo
* fix typo
* no cpu, no gpu for reduce scatter
---------
Co-authored-by: Awni Hannun <awni.hannun@gmail.com>
|
2025-11-05 08:21:11 -08:00 |
|
Angelos Katharopoulos
|
ddaa4b7dcb
|
Fix the test and add custom min/max reductions for uncommon MPI types (#2060)
|
2025-04-10 17:01:17 -07:00 |
|
Anastasiia Filippova
|
515f104926
|
Min / max reductions (#2041)
|
2025-04-09 23:22:20 -07:00 |
|
Angelos Katharopoulos
|
4eef8102c9
|
Distributed layers (#1270)
|
2025-03-21 13:52:17 -07:00 |
|
Awni Hannun
|
2a980a76ce
|
Add stats and limit to common allocator and enable tests (#1988)
* add stats to common allocator and enable tests
* linux memory and default
* fix
|
2025-03-21 12:28:36 -07:00 |
|
Awni Hannun
|
4e1994e9d7
|
move memory APIs into top level mlx.core (#1982)
|
2025-03-21 07:25:12 -07:00 |
|
Awni Hannun
|
3c3e558c60
|
Support transposed head/seq for kv (#1950)
* support transposed head/seq for kv
* fix flaky test
* nit
|
2025-03-10 10:53:45 -07:00 |
|
Awni Hannun
|
c707b2b0a6
|
Limit compile buffers (#1887)
* limit compile buffers
* maybe not flaky test
|
2025-02-19 20:28:13 -08:00 |
|
Angelos Katharopoulos
|
0145911bea
|
Fixes output donation for IO ops on the GPU (#1857)
|
2025-02-12 10:52:30 -08:00 |
|
Angelos Katharopoulos
|
ccb61d7aae
|
Ring distributed backend (#1784)
|
2025-01-27 22:15:01 -08:00 |
|
Awni Hannun
|
058d6ce683
|
mpi send use input as output (#1750)
* mpi send use input as output
* move earlier
|
2025-01-06 06:08:43 -08:00 |
|
Angelos Katharopoulos
|
914409fef9
|
Data parallel helper (#1407)
|
2024-09-16 18:17:21 -07:00 |
|
Angelos Katharopoulos
|
cdb59faea6
|
Adds send/recv ops in distributed (#1366)
|
2024-08-26 23:01:37 -07:00 |
|
Angelos Katharopoulos
|
0163a8e57a
|
Add docs for the distributed namespace (#1184)
|
2024-06-06 11:37:00 -07:00 |
|
Angelos Katharopoulos
|
50dfb664db
|
Comms (#1097)
* Start the communications branch using MPI
* Add ops and primitives
* Add python bindings for distributed
|
2024-05-23 17:04:02 -07:00 |
|