Large Language Model (LLM) API

LLM processor builder

build_processor

Build a processor using the given config.

Processor

Processor

A processor is composed of a preprocess stage, followed by one or more processing stages, and finally a postprocess stage.

Processor configs

ProcessorConfig	The processor configuration.
HttpRequestProcessorConfig	The configuration for the HTTP request processor.
vLLMEngineProcessorConfig	The configuration for the vLLM engine processor.
SGLangEngineProcessorConfig	The configuration for the SGLang engine processor.

Stage configs

ChatTemplateStageConfig	The configuration for the chat template stage.
TokenizerStageConfig	The configuration for the tokenizer stage.
DetokenizeStageConfig	The configuration for the detokenize stage.
PrepareMultimodalStageConfig	The configuration for the prepare multimodal stage.