Ray Serve API

The Ray Serve API reference documents Serve’s public Python API, CLI, and REST API. Each page below covers one group of APIs.

• Writing applications
  • Deployments and applications
  • Deployment decorators
• Deployment handles
  • Handle and response classes
  • Get a handle
• Running applications
• Configuration
  • Options and policies
  • Configuration models
• Runtime context
  • Replica and request context
  • gRPC context
• Request router
• Schemas
  • Status and details
  • Config schemas
  • Response schemas
• Exceptions
• Observability
  • Metrics
  • Logging and tracing
• LLM API
  • Builders
  • Configs
  • Deployments
• CLI
  • serve
• REST API
  • PUT "/api/serve/applications/"
  • GET "/api/serve/applications/"
  • DELETE "/api/serve/applications/"