Distributed Communication

MLX provides a distributed communication package using MPI. The MPI library is loaded at runtime; if MPI is available then distributed communication is also made available.

Group	An mlx.core.distributed.Group represents a group of independent mlx processes that can communicate.
is_available()	Check if a communication backend is available.
init([strict])	Initialize the communication backend and create the global communication group.
all_sum(x, *[, group])	All reduce sum.
all_gather(x, *[, group])	Gather arrays from all processes.