ray.data.Dataset.fully_executed

Dataset.fully_executed() → ray.data.dataset.Dataset[ray.data.block.T]

Force full evaluation of the blocks of this dataset.

This can be used to read all blocks into memory. By default, Datasets doesn’t read blocks from the datasource until the first transform.

Returns

A Dataset with all blocks fully materialized in memory.