ray.serve.request_router.RequestRouter.update_replicas

RequestRouter.update_replicas(replicas: List[RunningReplica])

Update the set of available replicas to be considered for routing.

When the set of replicas changes, we may spawn additional routing tasks if there are pending requests.