ray.serve.request_router.RequestRouter.target_num_routing_tasks

property RequestRouter.target_num_routing_tasks: int

Target number of routing tasks to be running based on pending requests.

This will never exceed self.max_num_routing_tasks.