Note

Ray 2.10.0 introduces the alpha stage of RLlib’s “new API stack”. The team is currently transitioning algorithms, example scripts, and documentation to the new code base throughout the subsequent minor releases leading up to Ray 3.0.

See here for more details on how to activate and use the new API stack.

Ray RLlib API

Tip

We’d love to hear your feedback on using RLlib - sign up to our forum and start asking questions!

This section contains an overview of RLlib’s package- and API reference. If you think there is anything missing, please open an issue on Github.

• Algorithms
  • Algorithm Configuration API
  • Building Custom Algorithm Classes
  • Algorithm API
• Environments
  • Env Vectorization
  • External Envs
  • Environment API Reference
• Policy API
  • Building Custom Policy Classes
  • Base Policy classes
  • Making models
  • Inference
  • Computing, processing, and applying gradients
  • Updating the Policy’s model
  • Loss, Logging, optimizers, and trajectory processing
  • Saving and restoring
  • Recurrent Policies
  • Miscellaneous
• Model APIs
  • Base Model classes
  • Feed Forward methods
  • Recurrent Models API
  • Acessing variables
  • Customization
• RLModule APIs
  • RLModule specifications and configurations
  • RLModule API
  • MultiRLModule API
• LearnerGroup API
  • Configuring a LearnerGroup and Learner actors
  • Constructing a LearnerGroup
• Learner API
  • Constructing a Learner
  • Implementing a custom RLModule to fit a Learner
  • Performing updates
  • Computing losses
  • Configuring optimizers
  • Gradient computation
  • Saving, loading, checkpointing, and restoring states
  • Adding and removing modules
• Sampling the Environment or offline data
  • RolloutWorker API
  • EnvRunner API
  • EnvRunnerGroup API
  • Sampler API
  • Policy Map API
  • Sample batch API
  • MultiAgent batch API
• Replay Buffer API
  • Replay Buffer Base Classes
  • Public Methods
  • Multi Agent Buffers
  • Utility Methods
• RLlib Utilities
  • Exploration API
  • Scheduler API
  • Training Operations Utilities
  • Framework Utilities
• External Application API
  • PolicyClient
  • PolicyServerInput