Observability

These APIs emit custom metrics from a deployment and configure Serve’s logging and tracing. The metric classes live in ray.serve.metrics. The logging and tracing configs live in ray.serve.schema.

Metrics

serve.metrics.Counter	A serve cumulative metric that is monotonically increasing.
serve.metrics.Histogram	Tracks the size and number of events in buckets.
serve.metrics.Gauge	Gauges keep the last recorded value and drop everything before.

Logging and tracing

serve.schema.LoggingConfig	Logging config schema for configuring serve components logs.
serve.schema.TracingConfig	Tracing config schema for configuring distributed tracing on Serve components.