ray.data.Dataset.get_internal_block_refs#

Dataset.get_internal_block_refs() List[ray.types.ObjectRef[Union[List[ray.data.block.T], pyarrow.Table, pandas.DataFrame, bytes]]][source]#

Get a list of references to the underlying blocks of this dataset.

This function can be used for zero-copy access to the data. It blocks until the underlying blocks are computed.

Note

This operation will trigger execution of the lazy transformations performed on this dataset, and will block until execution completes.

Time complexity: O(1)

Returns

A list of references to this dataset’s blocks.

DeveloperAPI: This API may change across minor Ray releases.