ray.serve.llm.LLMRouter.score

async LLMRouter.score(body: ScoreRequest) → starlette.responses.Response

Create scores for the provided text pairs.

Note: This is a vLLM specific endpoint.

Parameters:

body – The score request containing input text pairs to score.

Returns:

A response object with scores.