org.apache.spark.sql.hive.execution

Class InsertIntoHiveTable

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.hive.execution.InsertIntoHiveTable

All Implemented Interfaces:

com.typesafe.scalalogging.slf4j.Logging, java.io.Serializable, scala.Equals, scala.Product

public class InsertIntoHiveTable
extends SparkPlan
implements scala.Product, scala.Serializable

:: DeveloperApi ::

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
InsertIntoHiveTable(org.apache.spark.sql.hive.MetastoreRelation table, scala.collection.immutable.Map<String,scala.Option<String>> partition, SparkPlan child, boolean overwrite, HiveContext sc)

Method Summary

Methods

Modifier and Type	Method and Description
SparkPlan	child()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Inserts all the rows in the table into Hive.
scala.collection.immutable.List<HiveContext>	otherCopyArgs()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
Object	outputClass()
boolean	overwrite()
scala.collection.immutable.Map<String,scala.Option<String>>	partition()
void	saveAsHiveFile(RDD<org.apache.hadoop.io.Writable> rdd, Class<?> valueClass, org.apache.hadoop.hive.ql.plan.FileSinkDesc fileSinkConf, org.apache.hadoop.mapred.JobConf conf, boolean isCompressed)
org.apache.spark.sql.hive.MetastoreRelation	table()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

executeCollect, outputPartitioning, requiredChildDistribution

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, id, makeCopy, map, mapChildren, nextId, nodeName, numberedTreeString, sameInstance, simpleString, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface com.typesafe.scalalogging.slf4j.Logging

logger

Constructor Detail

InsertIntoHiveTable

public InsertIntoHiveTable(org.apache.spark.sql.hive.MetastoreRelation table,
                   scala.collection.immutable.Map<String,scala.Option<String>> partition,
                   SparkPlan child,
                   boolean overwrite,
                   HiveContext sc)

Method Detail

table

public org.apache.spark.sql.hive.MetastoreRelation table()

partition

public scala.collection.immutable.Map<String,scala.Option<String>> partition()

child

public SparkPlan child()

overwrite

public boolean overwrite()

outputClass

public Object outputClass()

otherCopyArgs

public scala.collection.immutable.List<HiveContext> otherCopyArgs()

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

saveAsHiveFile

public void saveAsHiveFile(RDD<org.apache.hadoop.io.Writable> rdd,
                  Class<?> valueClass,
                  org.apache.hadoop.hive.ql.plan.FileSinkDesc fileSinkConf,
                  org.apache.hadoop.mapred.JobConf conf,
                  boolean isCompressed)

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Inserts all the rows in the table into Hive. Row objects are properly serialized with the org.apache.hadoop.hive.serde2.SerDe and the org.apache.hadoop.mapred.OutputFormat provided by the table definition.

Specified by:

execute in class SparkPlan