Interface Summary |
CatalystScan |
::Experimental::
An interface for experimenting with a more direct connection to the query planner. |
CreatableRelationProvider |
|
HadoopFsRelationProvider |
::Experimental::
Implemented by objects that produce relations for a specific kind of data source
with a given schema and partitioned columns. |
InsertableRelation |
::DeveloperApi::
A BaseRelation that can be used to insert data into it through the insert method. |
PrunedFilteredScan |
::DeveloperApi::
A BaseRelation that can eliminate unneeded columns and filter using selected
predicates before producing an RDD containing all matching tuples as Row objects. |
PrunedScan |
::DeveloperApi::
A BaseRelation that can eliminate unneeded columns before producing an RDD
containing all of its tuples as Row objects. |
RelationProvider |
::DeveloperApi::
Implemented by objects that produce relations for a specific kind of data source. |
SchemaRelationProvider |
::DeveloperApi::
Implemented by objects that produce relations for a specific kind of data source
with a given schema. |
TableScan |
::DeveloperApi::
A BaseRelation that can produce all of its tuples as an RDD of Row objects. |
Class Summary |
And |
A filter that evaluates to true iff both left or right evaluate to true . |
BaseRelation |
::DeveloperApi::
Represents a collection of tuples with a known schema. |
EqualTo |
A filter that evaluates to true iff the attribute evaluates to a value
equal to value . |
Filter |
A filter predicate for data sources. |
GreaterThan |
A filter that evaluates to true iff the attribute evaluates to a value
greater than value . |
GreaterThanOrEqual |
A filter that evaluates to true iff the attribute evaluates to a value
greater than or equal to value . |
HadoopFsRelation |
::Experimental::
A BaseRelation that provides much of the common code required for formats that store their
data to an HDFS compatible filesystem. |
In |
A filter that evaluates to true iff the attribute evaluates to one of the values in the array. |
IsNotNull |
A filter that evaluates to true iff the attribute evaluates to a non-null value. |
IsNull |
A filter that evaluates to true iff the attribute evaluates to null. |
LessThan |
A filter that evaluates to true iff the attribute evaluates to a value
less than value . |
LessThanOrEqual |
A filter that evaluates to true iff the attribute evaluates to a value
less than or equal to value . |
Not |
A filter that evaluates to true iff child is evaluated to false . |
Or |
A filter that evaluates to true iff at least one of left or right evaluates to true . |
OutputWriter |
::Experimental::
OutputWriter is used together with HadoopFsRelation for persisting rows to the
underlying file system. |
OutputWriterFactory |
::Experimental::
A factory that produces OutputWriter s. |
StringContains |
A filter that evaluates to true iff the attribute evaluates to
a string that contains the string value . |
StringEndsWith |
A filter that evaluates to true iff the attribute evaluates to
a string that starts with value . |
StringStartsWith |
A filter that evaluates to true iff the attribute evaluates to
a string that starts with value . |