ray.data.datasource.TFRecordDatasource
ray.data.datasource.TFRecordDatasource#
- class ray.data.datasource.TFRecordDatasource[source]#
Bases:
ray.data.datasource.file_based_datasource.FileBasedDatasource
TFRecord datasource, for reading and writing TFRecord files.
PublicAPI (alpha): This API is in alpha and may change before becoming stable.
Methods
__init__
()do_write
(blocks, metadata, ray_remote_args, ...)Launch Ray tasks for writing blocks out to the datasource.
get_name
()Return a human-readable name for this datasource.
on_write_complete
(write_results, **kwargs)Callback for when a write job completes.
on_write_failed
(write_results, error, **kwargs)Callback for when a write job fails.
prepare_read
(parallelism, **read_args)Deprecated: Please implement create_reader() instead.
write
(blocks, ctx, path, dataset_uuid[, ...])Write blocks for a file-based datasource.