org.apache.spark.sql.hive.execution

Class HiveTableScan

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.hive.execution.HiveTableScan

All Implemented Interfaces:

com.typesafe.scalalogging.slf4j.Logging, java.io.Serializable, scala.Equals, scala.Product

public class HiveTableScan
extends SparkPlan
implements scala.Product, scala.Serializable

:: DeveloperApi :: The Hive table scan operator. Column and partition pruning are both handled.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HiveTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> attributes, org.apache.spark.sql.hive.MetastoreRelation relation, scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred, HiveContext sc)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	attributes()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
org.apache.spark.sql.hive.HadoopTableReader	hadoopReader()
RDD<?>	inputRdd()
org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector	objectInspector() The hive object inspector for this table, which can be used to extract values from the serialized row representation.
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
scala.Option<org.apache.spark.sql.catalyst.expressions.Expression>	partitionPruningPred()
org.apache.spark.sql.hive.MetastoreRelation	relation()
HiveContext	sc()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

executeCollect, outputPartitioning, requiredChildDistribution

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, id, makeCopy, map, mapChildren, nextId, nodeName, numberedTreeString, otherCopyArgs, sameInstance, simpleString, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface com.typesafe.scalalogging.slf4j.Logging

logger

Constructor Detail

HiveTableScan

public HiveTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> attributes,
             org.apache.spark.sql.hive.MetastoreRelation relation,
             scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred,
             HiveContext sc)

Method Detail

attributes

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> attributes()

relation

public org.apache.spark.sql.hive.MetastoreRelation relation()

partitionPruningPred

public scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred()

sc

public HiveContext sc()

hadoopReader

public org.apache.spark.sql.hive.HadoopTableReader hadoopReader()

objectInspector

public org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector objectInspector()

The hive object inspector for this table, which can be used to extract values from the serialized row representation.

inputRdd

public RDD<?> inputRdd()

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>