Ray Tune Examples
Contents
Ray Tune Examples#
Tip
Check out the Tune User Guides To learn more about Tune’s features in depth.
Examples using Ray Tune with ML Frameworks#
Ray Tune integrates with many popular machine learning frameworks. Here you find a few practical examples showing you how to tune your models. At the end of these guides you will often find links to even more examples.
Tune Experiment Tracking Examples#
Ray Tune integrates with some popular Experiment tracking and management tools, such as CometML, or Weights & Biases. If you’re interested in learning how to use Ray Tune with Tensorboard, you can find more information in our Guide to logging and outputs.
Tune Hyperparameter Optimization Framework Examples#
Tune integrates with a wide variety of hyperparameter optimization frameworks and their respective search algorithms. Here you can find detailed examples on each of our integrations:
Other Examples#
tune_basic_example: Simple example for doing a basic random and grid search.
Asynchronous HyperBand Example: Example of using a simple tuning function with AsyncHyperBandScheduler.
HyperBand Function Example: Example of using a Trainable function with HyperBandScheduler. Also uses the AsyncHyperBandScheduler.
Visualizing Population Based Training (PBT) Hyperparameter Optimization: Configuring and running (synchronous) PBT and understanding the underlying algorithm behavior with a simple example.
PBT Function Example: Example of using the function API with a PopulationBasedTraining scheduler.
PB2 Example: Example of using the Population-based Bandits (PB2) scheduler.
Logging Example: Example of custom loggers and custom trial directory naming.
Genetic Search Example: Optimizing the Michalewicz function using the contributed GeneticSearch algorithm with AsyncHyperBandScheduler.
Tune Exercises#
Learn how to use Tune in your browser with the following Colab-based exercises.
| Exercise Description | Library | Colab Link |
|---|---|---|
| Basics of using Tune. | TF/Keras |
|
| Using Search algorithms and Trial Schedulers to optimize your model. | Pytorch |
|
| Using Population-Based Training (PBT). | Pytorch |
|
| Fine-tuning Huggingface Transformers with PBT. | Huggingface Transformers/Pytorch |
|
| Logging Tune Runs to Comet ML. | Comet |
|
Tutorial source files can be found here.