ray.serve.config.AutoscalingContext.total_queued_requests#

AutoscalingContext.total_queued_requests: float | None#

Number of requests currently queued.