ray.data.DatasetPipeline.from_iterable#

static DatasetPipeline.from_iterable(iterable: Iterable[Callable[[], ray.data.dataset.Dataset[ray.data.block.T]]]) ray.data.dataset_pipeline.DatasetPipeline[ray.data.block.T][source]#

Create a pipeline from an sequence of Dataset producing functions.

Parameters

iterable – A finite or infinite-length sequence of functions that each produce a Dataset when called.