org.apache.spark.sql.dynamicpruning

Class CleanupDynamicPruningFilters

Object

org.apache.spark.sql.dynamicpruning.CleanupDynamicPruningFilters

public class CleanupDynamicPruningFilters
extends Object

Removes the filter nodes with dynamic pruning that were not pushed down to the scan. These nodes will not be pushed through projects and aggregates with non-deterministic expressions.

Constructor Summary

Constructors

Constructor and Description
CleanupDynamicPruningFilters()

Method Summary

Modifier and Type	Method and Description
static org.apache.spark.sql.catalyst.plans.logical.LogicalPlan	apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)
static scala.Option<scala.Tuple2<org.apache.spark.sql.catalyst.expressions.Expression,org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>>	findExpressionAndTrackLineageDown(org.apache.spark.sql.catalyst.expressions.Expression exp, org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)
static void	org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)
static org.slf4j.Logger	org$apache$spark$internal$Logging$$log_()
static String	ruleName()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CleanupDynamicPruningFilters

public CleanupDynamicPruningFilters()

Method Detail

apply

public static org.apache.spark.sql.catalyst.plans.logical.LogicalPlan apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

ruleName

public static String ruleName()

org$apache$spark$internal$Logging$$log_

public static org.slf4j.Logger org$apache$spark$internal$Logging$$log_()

org$apache$spark$internal$Logging$$log__$eq

public static void org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)

findExpressionAndTrackLineageDown

public static scala.Option<scala.Tuple2<org.apache.spark.sql.catalyst.expressions.Expression,org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>> findExpressionAndTrackLineageDown(org.apache.spark.sql.catalyst.expressions.Expression exp,
                                                                                                                                                                                         org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)