Ray Train Examples¶
Below are examples for using Ray Train with a variety of models, frameworks, and use cases.
General Examples¶
PyTorch¶
train_linear_example: Simple example for PyTorch.
train_fashion_mnist_example: End-to-end example for PyTorch.
transformers_example: End-to-end example for HuggingFace Transformers (PyTorch).
TensorFlow¶
tensorflow_mnist_example: End-to-end example for TensorFlow
Horovod¶
horovod_example: End-to-end example for Horovod (with PyTorch)
Logger/Callback Examples¶
mlflow_fashion_mnist_example: Example for logging training to MLflow via the
MLflowLoggerCallback
Ray Datasets Integration Examples¶
tensorflow_linear_dataset_example: Simple example for training a linear TensorFlow model.
train_linear_dataset_example: Simple example for training a linear PyTorch model.
tune_linear_dataset_example: Simple example for tuning a linear PyTorch model.
Ray Tune Integration Examples¶
tune_linear_example: Simple example for tuning a PyTorch model.
tune_tensorflow_mnist_example: End-to-end example for tuning a TensorFlow model.
tune_cifar_pytorch_pbt_example: End-to-end example for tuning a PyTorch model with PBT.
Benchmarks¶
Torch Data Prefetching Benchmark: Benchmark example for the PyTorch data transfer auto pipeline.