ray.serve.request_router.RequestRouter.update_backoff_params

RequestRouter.update_backoff_params(initial_backoff_s: float, backoff_multiplier: float, max_backoff_s: float) → None

Update the backoff parameters at runtime.

Parameters:

• initial_backoff_s – Initial backoff time in seconds.

• backoff_multiplier – Multiplier applied after each retry.

• max_backoff_s – Maximum backoff time in seconds.