Module execution

Shared state for query planning and execution.

Re-exports

pub use session_state::SessionState;

pub use session_state::SessionStateBuilder;

pub use crate::datasource::file_format::options;

Modules

cache

config

context

SessionContext API for registering data sources and executing queries

disk_manager

DiskManager: Manages files generated during query execution

memory_pool

MemoryPool for memory management during query execution, proxy for help with allocation accounting.

object_store

ObjectStoreRegistry holds all the object stores at Runtime with a scheme for each store. This allows the user to extend DataFusion with different storage systems such as S3 or HDFS and query data inside these systems.

registry

runtime_env

Execution RuntimeEnv environment that manages access to object store, memory manager, disk manager.

session_state

SessionState: information required to run queries in a session

Structs

DiskManager

Manages files generated during query execution, e.g. spill files generated while processing dataset larger than available memory.

SessionStateDefaults

Defaults that are used as part of creating a SessionState such as table providers, file formats, registering of builtin functions, etc.

TaskContext

Task Execution Context

Traits

FunctionRegistry

A registry knows how to build logical expressions out of user-defined function’ names

RecordBatchStream

Trait for types that stream RecordBatch

Type Aliases

SendableRecordBatchStream

Trait for a Stream of RecordBatches that can be passed between threads