reduce#

ray.util.collective.collective.reduce(tensor: Any, dst_rank: int = 0, group_name: str = 'default', op: ReduceOp = ReduceOp.SUM)[source]#

Reduce the tensor across the group to the destination rank.

Parameters:
  • tensor (Any) – the tensor to be reduced on this process.

  • dst_rank (int) – the rank of the destination process.

  • group_name (str) – the collective group name to perform reduce.

  • op (ReduceOp) – The reduce operation.