write

Datasink.write(blocks: Iterable[pyarrow.Table | pandas.DataFrame], ctx: TaskContext) → WriteReturnType

Write blocks. This is used by a single write task.

Parameters:

• blocks (Iterable[pyarrow.Table | pandas.DataFrame]) – Generator of data blocks.

• ctx (TaskContext) – TaskContext for the write task.

Returns:

Result of this write task. When the entire write operator finishes, All returned values will be passed as WriteResult.write_returns to Datasink.on_write_complete.

Return type:

WriteReturnType