ray.serve.request_router.RequestRouter.max_queue_len_response_deadline_s#
- RequestRouter.max_queue_len_response_deadline_s = 1.0#
Maximum deadline for receiving queue length info from replicas.
Site Navigation
uv
for Python package management in KubeRay