ray.serve.request_router.RunningReplica.try_send_request#
- RunningReplica.try_send_request(pr: PendingRequest, with_rejection: bool) ReplicaResult[source]#
Try to send the request to this replica. It may be rejected.
Try to send the request to this replica. It may be rejected.