Interface PrunedFilteredScan


public interface PrunedFilteredScan
A BaseRelation that can eliminate unneeded columns and filter using selected predicates before producing an RDD containing all matching tuples as Row objects.

The actual filter should be the conjunction of all filters, i.e. they should be "and" together.

The pushed down filters are currently purely an optimization as they will all be evaluated again. This means it is safe to use them with methods that produce false positives such as filtering partitions based on a bloom filter.

Since:
1.3.0
  • Method Summary

    Modifier and Type
    Method
    Description
    buildScan(String[] requiredColumns, Filter[] filters)
     
  • Method Details