ray.serve.llm.LLMServer.as_deployment

classmethod LLMServer.as_deployment(deployment_options: Dict[str, Any] = None) → Deployment

Convert the LLMServer to a Ray Serve deployment.

Parameters:

deployment_options – A dictionary of deployment options.

Returns:

A Ray Serve deployment.