ray.rllib.utils.schedules.schedule.Schedule

class ray.rllib.utils.schedules.schedule.Schedule(framework)

Schedule classes implement various time-dependent scheduling schemas.

• Constant behavior.

• Linear decay.

• Piecewise decay.

• Exponential decay.

Useful for backend-agnostic rate/weight changes for learning rates, exploration epsilons, beta parameters for prioritized replay, loss weights decay, etc..

Each schedule can be called directly with the t (absolute time step) value and returns the value dependent on the Schedule and the passed time.

Methods

value

Generates the value given a timestep (based on schedule's logic).