allgather#

ray.util.collective.collective.allgather(tensor_list: list, tensor: Any, group_name: str = 'default')[source]#

Allgather tensors from each process of the group into a list.

Parameters:
  • tensor_list (list) – the results, stored as a list of tensors.

  • tensor (Any) – the tensor (to be gathered) in the current process

  • group_name (str) – the name of the collective group.