Crate datafusion_datasource_parquet

ParquetExec FileSource for reading Parquet files

Re-exports

pub use access_plan::ParquetAccessPlan;

pub use access_plan::RowGroupAccess;

pub use file_format::*;

Modules

access_plan

file_format

ParquetFormat: Parquet FileFormat abstractions

source

ParquetSource implementation for reading parquet files

Structs

DefaultParquetFileReaderFactory

Default implementation of ParquetFileReaderFactory

PagePruningAccessPlanFilter

Filters a ParquetAccessPlan based on the Parquet PageIndex, if present

ParquetExecDeprecated

Deprecated Execution plan replaced with DataSourceExec

ParquetExecBuilderDeprecated

ParquetExecBuilder, deprecated builder for ParquetExec.

ParquetFileMetrics

Stores metrics about the parquet execution for a particular parquet file.

RowGroupAccessPlanFilter

Reduces the ParquetAccessPlan based on row group level metadata.

Traits

ParquetFileReaderFactory

Interface for reading parquet files.

Functions

build_row_filter

Build a RowFilter from the given predicate Expr if possible

can_expr_be_pushed_down_with_schemas

Recurses through expr as a tree, finds all columns, and checks if any of them would prevent this expression from being predicate pushed down. If any of them would, this returns false. Otherwise, true.

plan_to_parquet

Executes a query and writes the results to a partitioned Parquet file.