Ray Dataset Ingest into AIR Trainers#

See also

See this AIR Dataset ingest guide for usage examples.


Returns the ray.data.DatasetIterator shard for this worker.


An iterator for reading items from a Dataset or DatasetPipeline.

DatasetConfig([fit, split, required, ...])

Configuration for ingest of a single Dataset.

Debugging Utilities#

make_local_dataset_iterator(dataset, ...)

A helper function to create a local DatasetIterator, like the one returned by get_dataset_shard().

DummyTrainer(*args, **kwargs)

A Trainer that does nothing except read the data for a given number of epochs.