Skip to main content

Ctrl+K

Try Ray with $100 credit — Start now

Site Navigation

Get Started
Use Cases
Example Gallery
Library
APIs
Resources

Try Managed Ray

Site Navigation

Get Started
Use Cases
Example Gallery
Library
APIs
Resources

Try Managed Ray

Loading API navigation…

Ray APIs
Ray Serve API
RequestRouter
replica_queue_len_cache

replica_queue_len_cache#

property RequestRouter.replica_queue_len_cache: ReplicaQueueLengthCache#: Get the replica queue length cache.

previous

queue_len_response_deadline_s

next

supports_rejection_protocol

On this page

RequestRouter.replica_queue_len_cache

Thanks for the feedback!

Was this helpful?

Yes

No

Feedback

Submit

© Copyright 2026, The Ray Team.

Created using Sphinx 8.2.3.

Built with the PyData Sphinx Theme 0.18.0.