allreduce#

ray.util.collective.collective.allreduce(tensor: Any, group_name: str = 'default', op: ReduceOp = ReduceOp.SUM)[source]#

Collective allreduce the tensor across the group.

Parameters:

  • tensor (Any) – the tensor to be all-reduced on this process.

  • group_name (str) – the collective group name to perform allreduce.

  • op (ReduceOp) – The reduce operation.

On this page