ray.serve.request_router.RequestRouter.on_request_routed

RequestRouter.on_request_routed(pending_request: PendingRequest, replica_id: ReplicaID, result: ReplicaResult)

Called when a request is routed to a replica.

This is used as a callback to update the state of the request router after a response is generated.