ray.data.datasource.JSONDatasource
ray.data.datasource.JSONDatasource#
- class ray.data.datasource.JSONDatasource(*args, **kwds)[source]#
JSON datasource, for reading and writing JSON files.
Examples
>>> import ray >>> from ray.data.datasource import JSONDatasource >>> source = JSONDatasource() >>> ray.data.read_datasource( ... source, paths="/path/to/dir").take() [{"a": 1, "b": "foo"}, ...]
PublicAPI: This API is stable across Ray releases.
- __init__()#
Methods
__init__
()create_reader
(**kwargs)Return a Reader for the given read arguments.
do_write
(blocks, metadata, path, dataset_uuid)Creates and returns write tasks for a file-based datasource.
file_extension_filter
()on_write_complete
(write_results, **kwargs)Callback for when a write job completes.
on_write_failed
(write_results, error, **kwargs)Callback for when a write job fails.
prepare_read
(parallelism, **read_args)Deprecated: Please implement create_reader() instead.