Ray Serve API

• Ray Serve Python API
  • Core APIs
    • ray.serve.run
    • ray.serve.start
    • ray.serve.shutdown
    • ray.serve.delete
  • ServeHandle API
    • ray.serve.handle.RayServeHandle
      • ray.serve.handle.RayServeHandle.options
      • ray.serve.handle.RayServeHandle.remote
      • ray.serve.handle.RayServeHandle.is_polling
      • ray.serve.handle.RayServeHandle.is_same_loop
    • ray.serve.handle.RayServeHandle.remote
    • ray.serve.handle.RayServeHandle.options
  • Batching Requests
    • ray.serve.batch
  • Deployment Graph APIs
    • ray.serve.api.build
• Serve REST API
  • REST API
    • PUT "/api/serve/deployments/"
    • GET "/api/serve/deployments/status"
    • DELETE "/api/serve/deployments/"
  • Config Schema
  • Status Schema
• Serve CLI
  • serve
    • build
    • config
    • deploy
    • run
    • shutdown
    • start
    • status