ray.serve.llm.deployments.LLMRouter.as_deployment#

classmethod LLMRouter.as_deployment() → Deployment[source]#

Converts this class to a Ray Serve deployment with ingress.

Returns:: A Ray Serve deployment.