ray.serve.request_router.RequestRouter.on_send_request#

RequestRouter.on_send_request(replica_id: ReplicaID)[source]#

Increment queue length cache when a request is sent to a replica.