ray.train.DataConfig#

class ray.train.DataConfig(datasets_to_split: Union[Literal['all'], List[str]] = 'all', execution_options: Optional[ray.data._internal.execution.interfaces.execution_options.ExecutionOptions] = None)#

Class responsible for configuring Train dataset preprocessing.

For advanced use cases, this class can be subclassed and the configure() method overriden for custom data preprocessing.

Methods

__init__

Construct a DataConfig.

configure

Configure how Train datasets should be assigned to workers.

default_ingest_options

The default Ray Data options used for data ingest.