ray.data.datasource.DefaultParquetMetadataProvider#

class ray.data.datasource.DefaultParquetMetadataProvider[source]#

Bases: ray.data.datasource.file_meta_provider.ParquetMetadataProvider

The default file metadata provider for ParquetDatasource.

Aggregates total block bytes and number of rows using the Parquet file metadata associated with a list of Arrow Parquet dataset file fragments.

DeveloperAPI: This API may change across minor Ray releases.

Methods

__init__