ray.data.Dataset.get_internal_block_refs
ray.data.Dataset.get_internal_block_refs#
- Dataset.get_internal_block_refs() List[ray.types.ObjectRef[Union[pyarrow.Table, pandas.DataFrame]]] [source]#
Get a list of references to the underlying blocks of this dataset.
This function can be used for zero-copy access to the data. It blocks until the underlying blocks are computed.
Examples
>>> import ray >>> ds = ray.data.range(1) >>> ds.get_internal_block_refs() [ObjectRef(...)]
Note
This operation will trigger execution of the lazy transformations performed on this dataset.
Time complexity: O(1)
- Returns
A list of references to this dataset’s blocks.
DeveloperAPI: This API may change across minor Ray releases.