ray.serve.config.AutoscalingContext.total_num_requests

AutoscalingContext.total_num_requests: float

Total number of requests across all replicas.