@InterfaceStability.Evolving public interface SupportsPushDownRequiredColumns extends DataSourceReader
DataSourceReader
. Data source readers can implement this
interface to push down required columns to the data source and only read these columns during
scan to reduce the size of the data to be read.Modifier and Type | Method and Description |
---|---|
void |
pruneColumns(StructType requiredSchema)
Applies column pruning w.r.t.
|
planInputPartitions, readSchema
void pruneColumns(StructType requiredSchema)
DataSourceReader.readSchema()
after
applying column pruning.