ray.data.datasource.Reader
ray.data.datasource.Reader#
- class ray.data.datasource.Reader[source]#
Bases:
object
A bound read operation for a
Datasource
.This is a stateful class so that reads can be prepared in multiple stages. For example, it is useful for
Datasets
to know the in-memory size of the read prior to executing it.PublicAPI: This API is stable across Ray releases.
Methods
__init__
()Return an estimate of the in-memory data size, or None if unknown.
get_read_tasks
(parallelism)Execute the read and return read tasks.