distributed_sampler_kwargs#

property RayDeepSpeedStrategy.distributed_sampler_kwargs: Dict[str, Any]#

Keyword arguments for the distributed sampler.

num_replicas is the world size and rank is this worker’s global rank.