Ray Dataset Ingest into AIR Trainers

See also

See this AIR Dataset ingest guide for usage examples.

air.session.get_dataset_shard([dataset_name])	Returns the ray.data.DatasetIterator shard for this worker.
DatasetIterator()	An iterator for reading items from a Dataset or DatasetPipeline.
DatasetConfig([fit, split, required, ...])	Configuration for ingest of a single Dataset.

Debugging Utilities

make_local_dataset_iterator(dataset, ...)	A helper function to create a local DatasetIterator, like the one returned by get_dataset_shard().
DummyTrainer(*args, **kwargs)	A Trainer that does nothing except read the data for a given number of epochs.