allgather_multigpu# ray.util.collective.collective.allgather_multigpu(output_tensor_lists: list, input_tensor_list: list, group_name: str = 'default')[source]# Allgather tensors from each gpus of the group into lists. Parameters: output_tensor_lists (list) – gathered results, with shape must be num_gpus * world_size * shape(tensor). input_tensor_list (list) – a list of tensors, with shape num_gpus * shape(tensor). group_name (str) – the name of the collective group.