- class ray.air.util.check_ingest.DummyTrainer(*args, **kwargs)[source]#
A Trainer that does nothing except read the data for a given number of epochs.
It prints out as much debugging statistics as possible.
This is useful for debugging data ingest problem. This trainer supports normal scaling options same as any other Trainer (e.g., num_workers, use_gpu).
DeveloperAPI: This API may change across minor Ray releases.
Called during fit() to preprocess dataset attributes with preprocessor.
This method is run on a remote process.
This method is called prior to entering the training_loop.
Trainerhas both a datasets dict and a preprocessor, the datasets dict contains a training dataset (denoted by the “train” key), and the preprocessor has not yet been fit, then it will be fit on the train dataset.
Then, all Trainer’s datasets will be transformed by the preprocessor.
The transformed datasets will be set back in the
self.datasetsattribute of the Trainer to be used when overriding