- BaseTrainer.preprocess_datasets() None #
Called during fit() to preprocess dataset attributes with preprocessor.
This method is run on a remote process.
This method is called prior to entering the training_loop.
Trainerhas both a datasets dict and a preprocessor, the datasets dict contains a training dataset (denoted by the “train” key), and the preprocessor has not yet been fit, then it will be fit on the train dataset.
Then, all Trainer’s datasets will be transformed by the preprocessor.
The transformed datasets will be set back in the
self.datasetsattribute of the Trainer to be used when overriding