ray.data.Dataset.iter_internal_ref_bundles#

Dataset.iter_internal_ref_bundles() → Iterator[RefBundle][source]#

Get an iterator over RefBundles belonging to this Dataset. Calling this function doesn’t keep the data materialized in-memory.

Note

This operation will trigger execution of the lazy transformations performed on this dataset.

Examples

>>> import ray
>>> ds = ray.data.range(1)
>>> for ref_bundle in ds.iter_internal_ref_bundles():
...     for block_ref, block_md in ref_bundle.blocks:
...         block = ray.get(block_ref)

Returns:: An iterator over this Dataset’s RefBundles.

DeveloperAPI: This API may change across minor Ray releases.