ray.data.datasource.Reader#

class ray.data.datasource.Reader[source]#

A bound read operation for a Datasource.

This is a stateful class so that reads can be prepared in multiple stages. For example, it is useful for Datasets to know the in-memory size of the read prior to executing it.

Warning

DEPRECATED: This API is deprecated and may be removed in future Ray releases.

Methods

__init__

estimate_inmemory_data_size

Return an estimate of the in-memory data size, or None if unknown.

get_read_tasks

Execute the read and return read tasks.