ray.data.Dataset.write_datasource#

Dataset.write_datasource(datasource: Datasource, *, ray_remote_args: Dict[str, Any] = None, **write_args) None[source]#

Writes the dataset to a custom Datasource.

Note

This operation will trigger execution of the lazy transformations performed on this dataset.

Time complexity: O(dataset size / parallelism)

Parameters:
  • datasource – The Datasource to write to.

  • ray_remote_args – Kwargs passed to ray.remote in the write tasks.

  • write_args – Additional write args to pass to the Datasource.

Warning

DEPRECATED: This API is deprecated and may be removed in future Ray releases.