broadcast#

ray.util.collective.collective.broadcast(tensor: Any, src_rank: int = 0, group_name: str = 'default')[source]#

Broadcast the tensor from a source process to all others.

Parameters:
  • tensor (Any) – the tensor to be broadcasted (src) or received (destination).

  • src_rank (int) – the rank of the source process.

  • group_name (str) – the collective group name to perform broadcast.