pause

async PDPrefillServer.pause(**kwargs: Any) → None

Pause generation on the engine.

This halts generation requests while keeping model weights in GPU memory. New requests are blocked until resume is called.

Parameters:

**kwargs (Any) – Engine-specific pause options. Passed through to the engine.