Module datafusion::datasource::schema_adapter
source · Expand description
SchemaAdapter
and SchemaAdapterFactory
to adapt file-level record batches to a table schema.
Adapter provides a method of translating the RecordBatches that come out of the physical format into how they should be used by DataFusion. For instance, a schema can be stored external to a parquet file that maps parquet logical types to arrow types.
Structs§
- The SchemaMapping struct holds a mapping from the file schema to the table schema and any necessary type conversions that need to be applied.
Traits§
- Adapt file-level
RecordBatch
es to a table schema, which may have a schema obtained from merging multiple file-level schemas. - Factory for creating
SchemaAdapter
- Creates a
SchemaMapping
that can be used to cast or map the columns from the file schema to the table schema.