init_collective_group#

ray.util.collective.collective.init_collective_group(world_size: int, rank: int, backend: Backend = 'NCCL', group_name: str = 'default', gloo_timeout: int = 30000)[source]#

Initialize a collective group inside an actor process.

Parameters:

  • world_size (int) – the total number of processes in the group.

  • rank (int) – the rank of the current process.

  • backend (Backend) – the CCL backend to use, NCCL or GLOO.

  • group_name (str) – the name of the collective group.

  • gloo_timeout (int) – timeout in milliseconds for GLOO operations.