Interface SupportsReportPartitioning

All Superinterfaces:

@Evolving public interface SupportsReportPartitioning extends Scan
A mix in interface for Scan. Data sources can implement this interface to report data partitioning and try to avoid shuffle at Spark side.

Note that, when a Scan implementation creates exactly one InputPartition, Spark may avoid adding a shuffle even if the reader does not implement this interface.

  • Method Details

    • outputPartitioning

      Partitioning outputPartitioning()
      Returns the output data partitioning that this reader guarantees.