ray.experimental.TensorTransportManager

class ray.experimental.TensorTransportManager

Bases: ABC

Interface with which to implement custom tensor transports.

Methods

__init__
abort_transport	Abort the transport.
actor_has_tensor_transport	Whether the actor has the tensor transport available.
can_abort_transport	Whether the backend can abort the transport.
extract_tensor_transport_metadata	Extract the tensor transport metadata from the GPU object.
garbage_collect	Garbage collect for the tensor transport after the GPU object is freed.
get_communicator_metadata	Get the communicator metadata (e.g. communicator name, src/dst rank) for the send/recv operation.
is_one_sided	Whether the backend is one-sided.
recv_multiple_tensors	Receive multiple tensors from the source actor.
send_multiple_tensors	Send multiple tensors to the destination actor.
tensor_transport_backend	The tensor transport backend, e.g., NCCL.