Large Language Model (LLM) API#

LLM Processor Builder#

build_llm_processor

Build a LLM processor using the given config.

Processor#

Processor

A processor is composed of a preprocess stage, followed by one or more processing stages, and finally a postprocess stage.

Processor Configs#

ProcessorConfig

The processor configuration.

HttpRequestProcessorConfig

The configuration for the HTTP request processor.