ray.rllib.evaluation.worker_set.WorkerSet.foreach_policy

WorkerSet.foreach_policy(func: Callable[[Policy, str], T]) → List[T]

Calls func with each worker’s (policy, PolicyID) tuple.

Note that in the multi-agent case, each worker may have more than one policy.

Parameters:

func – A function - taking a Policy and its ID - that is called on all workers’ Policies.

Returns:

The list of return values of func over all workers’ policies. The

length of this list is: (num_workers + 1 (local-worker)) * [num policies in the multi-agent config dict]. The local workers’ results are first, followed by all remote workers’ results