record_routing_stats#
- async DPServer.record_routing_stats() Dict[str, Any]#
Serve request-router hook, polled by the controller.
Surfaces this replica’s routing stats (the engine’s KV-events endpoint for KV-aware routing); the LLMRouter’s own
KVTokenTrackerreads them off theLongPollreplica snapshot to register the worker.