sync_init#

classmethod DPServer.sync_init(llm_config: LLMConfig, *, engine_cls: Type[LLMEngine] | None = None, model_downloader: Type[LoraModelLoader] | None = None) → LLMServer#

Synchronous constructor that returns an unstarted instance.

This is used for testing the new pattern where initialization and starting are explicitly separated.

Parameters:

  • llm_config (LLMConfig) – LLMConfig for the model.

  • engine_cls (Type[LLMEngine] | None) – Dependency injection for the vllm engine class. Defaults to VLLMEngine.

  • model_downloader (Type[LoraModelLoader] | None) – Dependency injection for the model downloader. Defaults to LoraModelLoader.

Returns:

An unstarted LLMServer instance. Caller must call await start().

Return type:

LLMServer

On this page