update_target_network#

ray.rllib.utils.torch_utils.update_target_network(main_net: torch.nn.Module | keras.Model, target_net: torch.nn.Module | keras.Model, tau: float) → None[source]#

Updates a torch.nn.Module target network using Polyak averaging.

new_target_net_weight = (
    tau * main_net_weight + (1.0 - tau) * current_target_net_weight
)
Parameters:

  • main_net (torch.nn.Module | keras.Model) – The nn.Module to update from.

  • target_net (torch.nn.Module | keras.Model) – The target network to update.

  • tau (float) – The tau value to use in the Polyak averaging formula.