ray.serve.llm.deployments.VLLMService.as_deployment

classmethod VLLMService.as_deployment(deployment_options: Dict[str, Any] = None) → Deployment

Convert the VLLMService to a Ray Serve deployment.

Parameters:

deployment_options – A dictionary of deployment options.

Returns:

A Ray Serve deployment.