Examples

Production examples for deploying LLMs with Ray Serve.

Tutorials

Complete end-to-end tutorials for deploying different types of LLMs:

• Deploy a small-sized LLM

• Deploy a medium-sized LLM

• Deploy a large-sized LLM

• Deploy a vision LLM

• Deploy a reasoning LLM

• Deploy a hybrid reasoning LLM

• Deploy gpt-oss