ray.train.DataConfig
ray.train.DataConfig#
- class ray.train.DataConfig(datasets_to_split: Union[Literal['all'], List[str]] = 'all', execution_options: Optional[ray.data._internal.execution.interfaces.execution_options.ExecutionOptions] = None)#
Class responsible for configuring Train dataset preprocessing.
For advanced use cases, this class can be subclassed and the
configure()
method overriden for custom data preprocessing.Methods
Construct a DataConfig.
Configure how Train datasets should be assigned to workers.
The default Ray Data options used for data ingest.