__init__#

RowBasedFileDatasink.__init__(path: str, *, filesystem: pyarrow.fs.FileSystem | None = None, try_create_dir: bool = True, open_stream_args: Dict[str, Any] | None = None, filename_provider: FilenameProvider | None = None, dataset_uuid: str | None = None, file_format: str | None = None, mode: SaveMode = SaveMode.APPEND)#

Initialize this datasink.

Parameters:

  • path (str) – The folder to write files to.

  • filesystem (pyarrow.fs.FileSystem | None) – The filesystem to write files to. If not provided, the filesystem is inferred from the path.

  • try_create_dir (bool) – Whether to create the directory to write files to.

  • open_stream_args (Dict[str, Any] | None) – Arguments to pass to filesystem.open_output_stream.

  • filename_provider (FilenameProvider | None) – A ray.data.datasource.FilenameProvider that generates filenames for each row or block.

  • dataset_uuid (str | None) – The UUID of the dataset being written. If specified, it’s included in the filename.

  • file_format (str | None) – The file extension. If specified, files are written with this extension.

  • mode (SaveMode) – The save mode controlling behavior when the destination already exists (e.g., append, overwrite, error, ignore).