Crate datafusion_datasource_parquet

Re-exports

pub use access_plan::ParquetAccessPlan;

pub use access_plan::RowGroupAccess;

pub use file_format::*;

Modules

access_plan

file_format

ParquetFormat: Parquet FileFormat abstractions

source

ParquetSource implementation for reading parquet files

Structs

DefaultParquetFileReaderFactory

Default implementation of ParquetFileReaderFactory

PagePruningAccessPlanFilter

Filters a ParquetAccessPlan based on the Parquet PageIndex, if present

ParquetFileMetrics

Stores metrics about the parquet execution for a particular parquet file.

RowGroupAccessPlanFilter

Reduces the ParquetAccessPlan based on row group level metadata.

Traits

ParquetFileReaderFactory

Interface for reading parquet files.

Functions

build_row_filter

Build a RowFilter from the given predicate Expr if possible

can_expr_be_pushed_down_with_schemas

Recurses through expr as a tree, finds all columns, and checks if any of them would prevent this expression from being predicate pushed down. If any of them would, this returns false. Otherwise, true. Note that the schema passed in here is not the physical file schema (as it is not available at that point in time); it is the schema of the table that this expression is being evaluated against minus any projected columns and partition columns.

plan_to_parquet

Executes a query and writes the results to a partitioned Parquet file.