Crate datafusion_catalog

Interfaces and default implementations of catalogs and schemas.

Implementations

• Information schema: information_schema
• Simple memory based catalog: MemoryCatalogProviderList, MemoryCatalogProvider, MemorySchemaProvider

Re-exports

pub use memory::MemoryCatalogProvider;

pub use memory::MemoryCatalogProviderList;

pub use memory::MemorySchemaProvider;

Modules

information_schema

InformationSchemaProvider that implements the SQL Information Schema for DataFusion.

memory

MemoryCatalogProvider, MemoryCatalogProviderList: In-memory implementations of CatalogProviderList and CatalogProvider.

streaming

A simplified TableProvider for streaming partitioned datasets

Structs

DynamicFileCatalog

Wrap another catalog provider list

DynamicFileSchemaProvider

Implements the DynamicFileSchemaProvider that can create tables provider from the file path.

ResolvedTableReference

A fully resolved path to a table of the form “catalog.schema.table”

SessionStore

The state store that stores the reference of the runtime session state.

TableFunction

A table that uses a function to generate data

Enums

TableReference

A multi part identifier (path) to a table that may require further resolution (e.g. foo.bar).

Traits

AsyncCatalogProvider

A trait for catalog providers that must resolve schemas asynchronously

AsyncCatalogProviderList

A trait for catalog provider lists that must resolve catalogs asynchronously

AsyncSchemaProvider

A trait for schema providers that must resolve tables asynchronously

CatalogProvider

Represents a catalog, comprising a number of named schemas.

CatalogProviderList

Represent a list of named CatalogProviders.

SchemaProvider

Represents a schema, comprising a number of named tables.

Session

Interface for accessing SessionState from the catalog.

TableFunctionImpl

A trait for table function implementations

TableProvider

A table which can be queried and modified.

TableProviderFactory

A factory which creates TableProviders at runtime given a URL.

UrlTableFactory

UrlTableFactory is a factory that can create a table provider from the given url.

Functions

resolve_table_references

Collects all tables and views referenced in the SQL statement. CTEs are collected separately. This can be used to determine which tables need to be in the catalog for a query to be planned.