Ray Train Examples

Below are examples for using Ray Train with a variety of models, frameworks, and use cases.

General Examples

PyTorch

• torch_fashion_mnist_example: End-to-end example for PyTorch.

• transformers_example: End-to-end example for HuggingFace Transformers (PyTorch).

TensorFlow

• tensorflow_mnist_example: End-to-end example for TensorFlow

Horovod

• horovod_example: End-to-end example for Horovod (with PyTorch)

Logger/Callback Examples

• mlflow_fashion_mnist_example: Example for logging training to MLflow via the MLflowLoggerCallback

Ray Tune Integration Examples

• tune_tensorflow_mnist_example: End-to-end example for tuning a TensorFlow model.

• tune_cifar_torch_pbt_example: End-to-end example for tuning a PyTorch model with PBT.

Benchmarks

• Torch Data Prefetching Benchmark: Benchmark example for the PyTorch data transfer auto pipeline.