ray.data.Dataset.get_internal_block_refs#

Dataset.get_internal_block_refs() → List[ray.types.ObjectRef[Union[pyarrow.Table, pandas.DataFrame]]][source]#

Get a list of references to the underlying blocks of this dataset.

This function can be used for zero-copy access to the data. It blocks until the underlying blocks are computed.

Examples

>>> import ray
>>> ds = ray.data.range(1)
>>> ds.get_internal_block_refs()
[ObjectRef(...)]

Note

This operation will trigger execution of the lazy transformations performed on this dataset.

Time complexity: O(1)

Returns

A list of references to this dataset’s blocks.

DeveloperAPI: This API may change across minor Ray releases.