@Evolving public interface SupportsReportStatistics extends Scan
Scan
. Data sources can implement this interface to
report statistics to Spark.
As of Spark 2.4, statistics are reported to the optimizer before any operator is pushed to the
data source. Implementations that return more accurate statistics based on pushed operators will
not improve query performance until the planner can push operators before getting stats.Modifier and Type | Method and Description |
---|---|
Statistics |
estimateStatistics()
Returns the estimated statistics of this data source scan.
|
description, readSchema, toBatch, toContinuousStream, toMicroBatchStream
Statistics estimateStatistics()