ray.data.Dataset.get_internal_block_refs#

Dataset.get_internal_block_refs() List[ObjectRef[pyarrow.Table | pandas.DataFrame]][source]#

Get a list of references to the underlying blocks of this dataset.

This function can be used for zero-copy access to the data. It blocks until the underlying blocks are computed.

Examples

>>> import ray
>>> ds = ray.data.range(1)
>>> ds.get_internal_block_refs()
[ObjectRef(...)]

Note

This operation will trigger execution of the lazy transformations performed on this dataset.

Time complexity: O(1)

Returns:

A list of references to this dataset’s blocks.

DeveloperAPI: This API may change across minor Ray releases.