7 Commits

Author	SHA1	Message	Date
Anastasiia Filippova	27778156dc	Nccl reduce scatter, all gather (#2727) ... * Added reduce scatter and all gather for nccl * fix unused import, delete unused file * small fix * deleted useless condition * fixed comments * fix bug in eval_gpu, renamed to sum_scatter, fix docs * final fix docs * remove and * Update mlx/distributed/mpi/mpi.cpp Co-authored-by: Awni Hannun <awni.hannun@gmail.com> * fix broken set input output * fixes set output * typo * fix typo * no cpu, no gpu for reduce scatter --------- Co-authored-by: Awni Hannun <awni.hannun@gmail.com>	2025-11-05 08:21:11 -08:00
Awni Hannun	068a4612e9	nccl default for backend=any (#2528) ... * nccl default for backend=any * check num gpus + ensure row contiguous for all reduce * comment	2025-08-22 12:24:27 -07:00
Anastasiia Filippova	9392fc3f88	NCCL backend (#2476)	2025-08-21 11:56:15 -07:00
Anastasiia Filippova	515f104926	Min / max reductions (#2041)	2025-04-09 23:22:20 -07:00
Awni Hannun	c4230747a1	redesign for faster cpu/gpu synch (#1869) ... * redesign for faster cpu/gpu synch * load + more async CPU * use command encoder API and move more ops to use it * make fence back-end generic + CPU only fence * faster build * fix async eval * fixes + handle temporaries * fix / improve cpu conv * remove unused status, fix siblings * fix extensions * fix * fix no cpu build * format * comments * fix perf regression, remove unecessary abort * fix events, task limit cpu * fix waiting * fix donation / temporaries in normalization	2025-03-06 19:23:38 -08:00
Angelos Katharopoulos	ccb61d7aae	Ring distributed backend (#1784)	2025-01-27 22:15:01 -08:00
Angelos Katharopoulos	545f84d905	Refactor distributed backend (#1752)	2025-01-06 17:33:15 -08:00