Module catalog

re-export of datafusion_catalog crate

Modules

cte_worktable

CteWorkTable implementation used for recursive queries

default_table_source

Default TableSource implementation used in DataFusion physical plans

information_schema

InformationSchemaProvider that implements the SQL Information Schema for DataFusion.

listing_schema

ListingSchemaProvider: SchemaProvider that scans ObjectStores for tables automatically

memory

stream

TableProvider for stream sources, such as FIFO files

streaming

A simplified TableProvider for streaming partitioned datasets

view

View data source which uses a LogicalPlan as it’s input.

Structs

DynamicFileCatalog

Wrap another catalog provider list

DynamicFileSchemaProvider

Implements the DynamicFileSchemaProvider that can create tables provider from the file path.

MemTable

In-memory data source for presenting a Vec<RecordBatch> as a data source that can be queried by DataFusion. This allows data to be pre-loaded into memory and then repeatedly queried without incurring additional file I/O overhead.

MemoryCatalogProvider

Simple in-memory implementation of a catalog.

MemoryCatalogProviderList

Simple in-memory list of catalogs

MemorySchemaProvider

Simple in-memory implementation of a schema.

TableFunction

A table that uses a function to generate data

Traits

AsyncCatalogProvider

A trait for catalog providers that must resolve schemas asynchronously

AsyncCatalogProviderList

A trait for catalog provider lists that must resolve catalogs asynchronously

AsyncSchemaProvider

A trait for schema providers that must resolve tables asynchronously

CatalogProvider

Represents a catalog, comprising a number of named schemas.

CatalogProviderList

Represent a list of named CatalogProviders.

SchemaProvider

Represents a schema, comprising a number of named tables.

Session

Interface for accessing SessionState from the catalog and data source.

TableFunctionImpl

A trait for table function implementations

TableProvider

A table which can be queried and modified.

TableProviderFactory

A factory which creates TableProviders at runtime given a URL.

UrlTableFactory

UrlTableFactory is a factory that can create a table provider from the given url.