ray.serve.request_router.RunningReplica.try_send_request#
- RunningReplica.try_send_request(pr: PendingRequest, with_rejection: bool) ReplicaResult [source]#
Try to send the request to this replica. It may be rejected.
Site Navigation
uv
for Python package management in KubeRayTry to send the request to this replica. It may be rejected.