ray.data.Datasink.write#

Datasink.write(blocks: Iterable[pyarrow.Table | pandas.DataFrame], ctx: TaskContext) → WriteReturnType[source]#

Write blocks. This is used by a single write task.

Parameters:

  • blocks – Generator of data blocks.

  • ctx – TaskContext for the write task.

Returns:

Result of this write task. When the entire write operator finishes, All returned values will be passed as WriteResult.write_returns to Datasink.on_write_complete.