Package org.apache.spark.sql.sources

package org.apache.spark.sql.sources
  • Class
    Description
    AlwaysFalse
    A filter that always evaluates to false.
    AlwaysTrue
    A filter that always evaluates to true.
    And
    A filter that evaluates to true iff both left or right evaluate to true.
    BaseRelation
    Represents a collection of tuples with a known schema.
    CatalystScan
    ::Experimental:: An interface for experimenting with a more direct connection to the query planner.
    CreatableRelationProvider
     
    DataSourceRegister
    Data sources should implement this trait so that they can register an alias to their data source.
    EqualNullSafe
    Performs equality comparison, similar to EqualTo.
    EqualTo
    A filter that evaluates to true iff the column evaluates to a value equal to value.
    Filter
    A filter predicate for data sources.
    GreaterThan
    A filter that evaluates to true iff the attribute evaluates to a value greater than value.
    GreaterThanOrEqual
    A filter that evaluates to true iff the attribute evaluates to a value greater than or equal to value.
    In
    A filter that evaluates to true iff the attribute evaluates to one of the values in the array.
    InsertableRelation
    A BaseRelation that can be used to insert data into it through the insert method.
    IsNotNull
    A filter that evaluates to true iff the attribute evaluates to a non-null value.
    IsNull
    A filter that evaluates to true iff the attribute evaluates to null.
    LessThan
    A filter that evaluates to true iff the attribute evaluates to a value less than value.
    LessThanOrEqual
    A filter that evaluates to true iff the attribute evaluates to a value less than or equal to value.
    Not
    A filter that evaluates to true iff child is evaluated to false.
    Or
    A filter that evaluates to true iff at least one of left or right evaluates to true.
    PrunedFilteredScan
    A BaseRelation that can eliminate unneeded columns and filter using selected predicates before producing an RDD containing all matching tuples as Row objects.
    PrunedScan
    A BaseRelation that can eliminate unneeded columns before producing an RDD containing all of its tuples as Row objects.
    RelationProvider
    Implemented by objects that produce relations for a specific kind of data source.
    SchemaRelationProvider
    Implemented by objects that produce relations for a specific kind of data source with a given schema.
    StreamSinkProvider
    ::Experimental:: Implemented by objects that can produce a streaming Sink for a specific format or system.
    StreamSourceProvider
    ::Experimental:: Implemented by objects that can produce a streaming Source for a specific format or system.
    StringContains
    A filter that evaluates to true iff the attribute evaluates to a string that contains the string value.
    StringEndsWith
    A filter that evaluates to true iff the attribute evaluates to a string that ends with value.
    StringStartsWith
    A filter that evaluates to true iff the attribute evaluates to a string that starts with value.
    SupportsStreamSourceMetadataColumns
    Implemented by StreamSourceProvider objects that can generate file metadata columns.
    TableScan
    A BaseRelation that can produce all of its tuples as an RDD of Row objects.