Module datafusion::execution

Shared state for query planning and execution.

Re-exports

• pub use crate::datasource::file_format::options;

Modules

• cache
• config
• context
  SessionContext API for registering data sources and executing queries
• disk_manager
  Manages files generated during query execution, files are hashed among the directories listed in RuntimeConfig::local_dirs.
• memory_pool
  MemoryPool for memory management during query execution, [proxy] for help with allocation accounting.
• object_store
  ObjectStoreRegistry holds all the object stores at Runtime with a scheme for each store. This allows the user to extend DataFusion with different storage systems such as S3 or HDFS and query data inside these systems.
• registry
• runtime_env
  Execution RuntimeEnv environment that manages access to object store, memory manager, disk manager.
• session_state
  SessionState: information required to run queries in a session

Structs

• DiskManager
  Manages files generated during query execution, e.g. spill files generated while processing dataset larger than available memory.
• TaskContext
  Task Execution Context

Traits

• FunctionRegistry
  A registry knows how to build logical expressions out of user-defined function’ names
• RecordBatchStream
  Trait for types that stream arrow::record_batch::RecordBatch

Type Aliases

• SendableRecordBatchStream
  Trait for a Stream of RecordBatches