ray.train.lightning.RayDeepSpeedStrategy#

class ray.train.lightning.RayDeepSpeedStrategy(*args: Any, **kwargs: Any)[source]#

Bases: DeepSpeedStrategy

Subclass of DeepSpeedStrategy to ensure compatibility with Ray orchestration.

For a full list of initialization arguments, please refer to: https://lightning.ai/docs/pytorch/stable/api/lightning.pytorch.strategies.DeepSpeedStrategy.html

PublicAPI (beta): This API is in beta and may change before becoming stable.

Methods

Attributes

distributed_sampler_kwargs

root_device