Large Language Model (LLM) API

LLM processor builder

build_llm_processor

Build a LLM processor using the given config.

Processor

Processor

A processor is composed of a preprocess stage, followed by one or more processing stages, and finally a postprocess stage.

Processor configs

ProcessorConfig	The processor configuration.
HttpRequestProcessorConfig	The configuration for the HTTP request processor.
vLLMEngineProcessorConfig	The configuration for the vLLM engine processor.
SGLangEngineProcessorConfig	The configuration for the SGLang engine processor.