ReplayBuffer.__init__(capacity: int = 10000, storage_unit: str | StorageUnit = 'timesteps', **kwargs)[source]#

Initializes a (FIFO) ReplayBuffer instance.

  • capacity – Max number of timesteps to store in this FIFO buffer. After reaching this number, older samples will be dropped to make space for new ones.

  • storage_unit – If not a StorageUnit, either ‘timesteps’, ‘sequences’ or ‘episodes’. Specifies how experiences are stored.

  • **kwargs – Forward compatibility kwargs.