ray.data.Dataset.get_internal_block_refs#

Dataset.get_internal_block_refs() List[ray.types.ObjectRef[Union[List[ray.data.block.T], pyarrow.Table, pandas.DataFrame, bytes]]][source]#

Get a list of references to the underlying blocks of this dataset.

This function can be used for zero-copy access to the data. It blocks until the underlying blocks are computed.

Time complexity: O(1)

Returns

A list of references to this dataset’s blocks.

DeveloperAPI: This API may change across minor Ray releases.