ray.serve.llm.LLMRouter.detokenize#
- async LLMRouter.detokenize(body: DetokenizeRequest, request: fastapi.Request) starlette.responses.Response#
Convert token IDs back to text.
This endpoint detokenizes the provided token IDs and returns the corresponding text.
Note: This is a vLLM specific endpoint.
- Parameters:
body – The detokenize request containing the token IDs.
request – The raw FastAPI request object.
- Returns:
A response object with the detokenized text.