ray.data.Dataset.get_internal_block_refs
ray.data.Dataset.get_internal_block_refs#
- Dataset.get_internal_block_refs() List[ray.types.ObjectRef[Union[List[ray.data.block.T], pyarrow.Table, pandas.DataFrame, bytes]]][source]#
Get a list of references to the underlying blocks of this dataset.
This function can be used for zero-copy access to the data. It blocks until the underlying blocks are computed.
Note
This operation will trigger execution of the lazy transformations performed on this dataset, and will block until execution completes.
Time complexity: O(1)
- Returns
A list of references to this dataset’s blocks.
DeveloperAPI: This API may change across minor Ray releases.