ray.serve.request_router.RunningReplica.try_send_request#
- RunningReplica.try_send_request(pr: PendingRequest, with_rejection: bool) ReplicaResult[source]#
Try to send the request to this replica. It may be rejected.
Site Navigation
uv for Python package management in KubeRayTry to send the request to this replica. It may be rejected.