Exceptions

The ray.serve.exceptions module defines the errors Serve raises to callers and deployments.

serve.exceptions.BackPressureError	Raised when max_queued_requests is exceeded on a DeploymentHandle.
serve.exceptions.RayServeException
serve.exceptions.RequestCancelledError	Raise when a Serve request is cancelled.
serve.exceptions.gRPCStatusError	Internal exception that wraps an exception with user-set gRPC status code.
serve.exceptions.DeploymentUnavailableError	Raised when a Serve deployment is unavailable to receive requests.
serve.exceptions.ReplicaUnavailableError	Raised when the selected replica is no longer available.