ray.rllib.utils.replay_buffers.reservoir_replay_buffer.ReservoirReplayBuffer.__init__#

ReservoirReplayBuffer.__init__(capacity: int = 10000, storage_unit: str = 'timesteps', **kwargs)[source]#

Initializes a ReservoirBuffer instance.

Parameters:

  • capacity – Max number of timesteps to store in the FIFO buffer. After reaching this number, older samples will be dropped to make space for new ones.

  • storage_unit – Either ‘timesteps’, ‘sequences’ or ‘episodes’. Specifies how experiences are stored.