public class ParquetTableScan extends SparkPlan implements scala.Product, scala.Serializable
ParquetRelation
as a RDD[Row].Constructor and Description |
---|
ParquetTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output,
org.apache.spark.sql.parquet.ParquetRelation relation,
scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> columnPruningPred,
SparkContext sc) |
Modifier and Type | Method and Description |
---|---|
scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> |
columnPruningPred() |
RDD<org.apache.spark.sql.catalyst.expressions.Row> |
execute()
Runs this query returning the result as an RDD.
|
scala.collection.immutable.List<SparkContext> |
otherCopyArgs() |
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> |
output() |
ParquetTableScan |
pruneColumns(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> prunedAttributes)
Applies a (candidate) projection.
|
org.apache.spark.sql.parquet.ParquetRelation |
relation() |
SparkContext |
sc() |
executeCollect, outputPartitioning, requiredChildDistribution
expressions, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp
apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, id, makeCopy, map, mapChildren, nextId, nodeName, numberedTreeString, sameInstance, simpleString, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren
public ParquetTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output, org.apache.spark.sql.parquet.ParquetRelation relation, scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> columnPruningPred, SparkContext sc)
public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()
output
in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>
public org.apache.spark.sql.parquet.ParquetRelation relation()
public scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> columnPruningPred()
public SparkContext sc()
public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()
SparkPlan
public scala.collection.immutable.List<SparkContext> otherCopyArgs()
public ParquetTableScan pruneColumns(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> prunedAttributes)
prunedAttributes
- The list of attributes to be used in the projection.