ray.serve.llm.LLMRouter.score

async LLMRouter.score(body: ScoreRequest, request: fastapi.Request) → starlette.responses.Response

Create scores for the provided text pairs.

Note: This is a vLLM specific endpoint.

Parameters:

• body – The score request containing input text pairs to score.

• request – The raw FastAPI request object.

Returns:

A response object with scores.