record_replica_metadata#
- async PDPrefillServer.record_replica_metadata() Dict[str, Any][source]#
Publish this prefill replica’s connector coordination metadata.
Read by the decode orchestrator via the replica-metadata hook (
ReplicaSelection.replica_metadata) so peer-binding connectors (e.g. MoRIIO) can address the selected prefill replica. Returns{}for connectors that publish nothing (theBaseConnectorBackenddefault).Returns the metadata of the backend that engine init (
setup_engine_backend) created,setup()-ed, and stored on this server’s_llm_config. The replica-metadata hook is captured after engine init, so for connector deployments the backend is present by then; with no backend stored there is nothing to publish.