org.apache.spark.sql

sources

package sources

A set of APIs for adding data sources to Spark SQL.

Source
package.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. sources
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. case class And(left: Filter, right: Filter) extends Filter with Product with Serializable

    A filter that evaluates to true iff both left or right evaluate to true.

  2. abstract class BaseRelation extends AnyRef

    ::DeveloperApi:: Represents a collection of tuples with a known schema.

  3. trait CatalystScan extends AnyRef

    ::Experimental:: An interface for experimenting with a more direct connection to the query planner.

  4. trait CreatableRelationProvider extends AnyRef

  5. trait DataSourceRegister extends AnyRef

    ::DeveloperApi:: Data sources should implement this trait so that they can register an alias to their data source.

  6. case class EqualNullSafe(attribute: String, value: Any) extends Filter with Product with Serializable

    Performs equality comparison, similar to EqualTo.

  7. case class EqualTo(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value equal to value.

  8. abstract class Filter extends AnyRef

    A filter predicate for data sources.

  9. case class GreaterThan(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value greater than value.

  10. case class GreaterThanOrEqual(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value greater than or equal to value.

  11. abstract class HadoopFsRelation extends BaseRelation with FileRelation with Logging

    ::Experimental:: A BaseRelation that provides much of the common code required for relations that store their data to an HDFS compatible filesystem.

  12. trait HadoopFsRelationProvider extends AnyRef

    ::Experimental:: Implemented by objects that produce relations for a specific kind of data source with a given schema and partitioned columns.

  13. case class In(attribute: String, values: Array[Any]) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to one of the values in the array.

  14. trait InsertableRelation extends AnyRef

    ::DeveloperApi:: A BaseRelation that can be used to insert data into it through the insert method.

  15. case class IsNotNull(attribute: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a non-null value.

  16. case class IsNull(attribute: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to null.

  17. case class LessThan(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value less than value.

  18. case class LessThanOrEqual(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value less than or equal to value.

  19. case class Not(child: Filter) extends Filter with Product with Serializable

    A filter that evaluates to true iff child is evaluated to false.

  20. case class Or(left: Filter, right: Filter) extends Filter with Product with Serializable

    A filter that evaluates to true iff at least one of left or right evaluates to true.

  21. abstract class OutputWriter extends AnyRef

    ::Experimental:: OutputWriter is used together with HadoopFsRelation for persisting rows to the underlying file system.

  22. abstract class OutputWriterFactory extends Serializable

    ::Experimental:: A factory that produces OutputWriters.

  23. trait PrunedFilteredScan extends AnyRef

    ::DeveloperApi:: A BaseRelation that can eliminate unneeded columns and filter using selected predicates before producing an RDD containing all matching tuples as Row objects.

  24. trait PrunedScan extends AnyRef

    ::DeveloperApi:: A BaseRelation that can eliminate unneeded columns before producing an RDD containing all of its tuples as Row objects.

  25. trait RelationProvider extends AnyRef

    ::DeveloperApi:: Implemented by objects that produce relations for a specific kind of data source.

  26. trait SchemaRelationProvider extends AnyRef

    ::DeveloperApi:: Implemented by objects that produce relations for a specific kind of data source with a given schema.

  27. case class StringContains(attribute: String, value: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a string that contains the string value.

  28. case class StringEndsWith(attribute: String, value: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a string that starts with value.

  29. case class StringStartsWith(attribute: String, value: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a string that starts with value.

  30. trait TableScan extends AnyRef

    ::DeveloperApi:: A BaseRelation that can produce all of its tuples as an RDD of Row objects.

Inherited from AnyRef

Inherited from Any

Ungrouped