ray.serve.request_router.RequestRouter.queue_len_response_deadline_s#

RequestRouter.queue_len_response_deadline_s = 0.1#

Deadline for receiving queue length info from replicas.