ray.data.datasource.PathPartitionParser.__init__

PathPartitionParser.__init__(partitioning: Partitioning)

Creates a path-based partition parser.

Parameters:

partitioning – The path-based partition scheme. The parser starts searching for partitions from this scheme’s base directory. File paths outside the base directory will be considered unpartitioned. If the base directory is None or an empty string then this will search for partitions in all file path directories. Field names are required for DIRECTORY partitioning, and optional for HIVE partitioning. When non-empty, the order and length of partition key field names must match the order and length of partition directories discovered.