ray.serve.grpc_util.gRPCInputStream.__init__#

gRPCInputStream.__init__(request_iterator: AsyncIterator[T], *, cancel_event: Event | None = None)[source]#

Initialize the gRPCInputStream.

Parameters:

  • request_iterator – The underlying async iterator of request messages.

  • cancel_event – Optional event that signals cancellation from the client.