Struct datafusion::physical_plan::parquet::ParquetPartition

pub struct ParquetPartition {
    pub filenames: Vec<String>,
    pub statistics: Statistics,
    // some fields omitted
}

Represents one partition of a Parquet data set and this currently means one Parquet file.

In the future it would be good to support subsets of files based on ranges of row groups so that we can better parallelize reads of large files across available cores (see ARROW-10995).

We may also want to support reading Parquet files that are partitioned based on a key and in this case we would want this partition struct to represent multiple files for a given partition key (see ARROW-11019).

Fields

filenames: Vec<String>

The Parquet filename for this partition

statistics: Statistics

Statistics for this partition

Implementations

impl ParquetPartition

pub fn new(filenames: Vec<String>, statistics: Statistics) -> Self

Create a new parquet partition

pub fn filenames(&self) -> &[String]

The Parquet filename for this partition

pub fn statistics(&self) -> &Statistics

Statistics for this partition

Trait Implementations

impl Clone for ParquetPartition

fn clone(&self) -> ParquetPartition

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ParquetPartition

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.