ray.serve.llm.LLMRouter.embeddings

async LLMRouter.embeddings(body: EmbeddingCompletionRequest | EmbeddingChatRequest) → starlette.responses.Response

Create embeddings for the provided input.

Parameters:

body – The EmbeddingRequest object.

Returns:

A response object with embeddings.