Crate datafusion_physical_optimizer

Modules

• aggregate_statistics
  Utilizing exact statistics from sources to avoid scanning data
• coalesce_batches
  CoalesceBatches optimizer that groups batches together rows in bigger batches to avoid overhead with small batches
• combine_partial_final_agg
  CombinePartialFinalAggregate optimizer rule checks the adjacent Partial and Final AggregateExecs and try to combine them if necessary
• limit_pushdown
  LimitPushdown pushes LIMIT down through ExecutionPlans to reduce data transfer as much as possible.
• limited_distinct_aggregation
  A special-case optimizer rule that pushes limit into a grouped aggregation which has no aggregate expressions or sorting requirements
• output_requirements
  The GlobalOrderRequire optimizer rule either:
• pruning
  PruningPredicate to apply filter Expr to prune “containers” based on statistics (e.g. Parquet Row Groups)
• topk_aggregation
  An optimizer rule that detects aggregate operations that could use a limited bucket count
• update_aggr_exprs
  An optimizer rule that checks ordering requirements of aggregate expressions and modifies the expressions to work more efficiently if possible.

Traits

• PhysicalOptimizerRule
  PhysicalOptimizerRule transforms one [‘ExecutionPlan’] into another which computes the same results, but in a potentially more efficient way.