ray.data.DatasetPipeline.foreach_window#

DatasetPipeline.foreach_window(fn: Callable[[ray.data.dataset.Dataset[ray.data.block.T]], ray.data.dataset.Dataset[ray.data.block.U]]) → ray.data.dataset_pipeline.DatasetPipeline[ray.data.block.U][source]#

Apply a transform to each dataset/window in this pipeline.

Parameters

fn – The function to transform each dataset with.

Returns

The transformed DatasetPipeline.

DeveloperAPI: This API may change across minor Ray releases.