__init__

ReservoirReplayBuffer.__init__(capacity: int = 10000, storage_unit: str = 'timesteps', **kwargs)

Initializes a ReservoirBuffer instance.

Parameters:

• capacity (int) – Max number of timesteps to store in the FIFO buffer. After reaching this number, older samples will be dropped to make space for new ones.

• storage_unit (str) – Either ‘timesteps’, ‘sequences’ or ‘episodes’. Specifies how experiences are stored.