Examples

Below is a list of tutorials that you can use to learn more about the different pieces of Ray Serve functionality and how to integrate different modeling frameworks.

Serve Examples

• Serving ML Models (Tensorflow, PyTorch, Scikit-Learn, others)
• Batching Tutorial
  • Define the Deployment
  • Deploy the Deployment
  • Deploy the Deployment using Python API
• Serving RLlib Models
• Scaling your Gradio app with Ray Serve
  • Dependencies
  • Quickstart: Deploy your Gradio app with Ray Serve
    • Deploying Gradio Server
  • Parallelizing models with Ray Serve
    • Original Approach
    • Parallelize using Ray Serve
• Java Tutorial
  • Example Model
  • Converting to a Ray Serve Deployment
  • Testing the Ray Serve Deployment
  • Calling Ray Serve Deployment with HTTP