Called before gradient-based updates are completed.
Should be overridden to implement custom preparation-, logging-, or
non-gradient-based Learner/RLModule update logic before(!) gradient-based
updates are performed.
- Parameters:
timesteps (Dict[str, Any]) – Timesteps dict, which must have the key
NUM_ENV_STEPS_SAMPLED_LIFETIME.
# TODO (sven): Make this a more formal structure with its own type.