.. _train-examples: Ray Train Examples ================== .. Organize example .rst files in the same manner as the .py files in ray/python/ray/train/examples. Below are examples for using Ray Train with a variety of frameworks and use cases. Beginner -------- .. list-table:: :widths: 1 5 :header-rows: 1 * - Framework - Example * - PyTorch - :ref:`Train a Fashion MNIST Image Classifier with PyTorch ` * - Lightning - :ref:`Train an MNIST Image Classifier with Lightning ` * - Transformers - :ref:`Fine-tune a Text Classifier on the Yelp Reviews Dataset with Hugging Face Transformers ` * - Accelerate - :ref:`Distributed Data Parallel Training with Hugging Face Accelerate ` * - DeepSpeed - :ref:`Train with DeepSpeed ZeRO-3 ` * - TensorFlow - :ref:`Train an MNIST Image Classifier with TensorFlow ` * - Horovod - :ref:`Train with Horovod and PyTorch ` Intermediate ------------ .. list-table:: :widths: 1 5 :header-rows: 1 * - Framework - Example * - PyTorch - :ref:`Fine-tune of Stable Diffusion with DreamBooth and Ray Train ` * - Lightning - :ref:`Train with PyTorch Lightning and Ray Data ` * - Transformers - :ref:`Fine-tune a Text Classifier on GLUE Benchmark with Hugging Face Accelerate ` Advanced -------- .. list-table:: :widths: 1 5 :header-rows: 1 * - Framework - Example * - Accelerate, DeepSpeed - `Fine-tune Llama-2 series models with Deepspeed, Accelerate, and Ray Train TorchTrainer `_ * - Transformers, DeepSpeed - :ref:`Fine-tune GPT-J-6B with Ray Train and DeepSpeed ` * - Lightning, DeepSpeed - :ref:`Fine-tune vicuna-13b with PyTorch Lightning and DeepSpeed ` * - Lightning - :ref:`Fine-tune dolly-v2-7b with PyTorch Lightning and FSDP `