ray.serve.request_router.RequestRouter.on_new_queue_len_info# RequestRouter.on_new_queue_len_info(replica_id: ReplicaID, num_ongoing_requests: int)[source]# Update queue length cache with new info received from replica.