ray.data.Dataset.cache

Dataset.cache() → ray.data.dataset.Dataset[ray.data.block.T]

Evaluate and cache the blocks of this Dataset in object store memory.

Note

This operation will trigger execution of the lazy transformations performed on this dataset.

This can be used to read all blocks into memory. By default, Datasets doesn’t read blocks from the datasource until the first transform.

Returns

A Dataset with all blocks fully materialized in memory.