ray.data.datasource.ParquetMetadataProvider#

class ray.data.datasource.ParquetMetadataProvider[source]#

Bases: FileMetadataProvider

Provides block metadata for Arrow Parquet file fragments.

DeveloperAPI: This API may change across minor Ray releases.

Methods

__init__

prefetch_file_metadata

Pre-fetches file metadata for all Parquet file fragments in a single batch.