ray.serve.llm.LLMRouter.model_data

async LLMRouter.model_data(model: str) → ModelCard

OpenAI API-compliant endpoint to get one rayllm model.

Parameters:

model – The model ID (e.g. “amazon/LightGPT”)