Class

org.apache.spark.sql

SQLImplicits

Related Doc: package sql

Permalink

abstract class SQLImplicits extends LowPrioritySQLImplicits

A collection of implicit methods for converting common Scala objects into Datasets.

Annotations
@Evolving()
Source
SQLImplicits.scala
Since

1.6.0

Linear Supertypes
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SQLImplicits
  2. LowPrioritySQLImplicits
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SQLImplicits()

    Permalink

Type Members

  1. implicit class StringToColumn extends AnyRef

    Permalink

    Converts $"col name" into a Column.

    Converts $"col name" into a Column.

    Since

    2.0.0

Abstract Value Members

  1. abstract def _sqlContext: SQLContext

    Permalink
    Attributes
    protected

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  10. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  11. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  12. implicit def localSeqToDatasetHolder[T](s: Seq[T])(implicit arg0: Encoder[T]): DatasetHolder[T]

    Permalink

    Creates a Dataset from a local Seq.

    Creates a Dataset from a local Seq.

    Since

    1.6.0

  13. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. implicit def newBooleanArrayEncoder: Encoder[Array[Boolean]]

    Permalink

    Since

    1.6.1

  15. implicit def newBooleanEncoder: Encoder[Boolean]

    Permalink

    Since

    1.6.0

  16. implicit def newBoxedBooleanEncoder: Encoder[Boolean]

    Permalink

    Since

    2.0.0

  17. implicit def newBoxedByteEncoder: Encoder[Byte]

    Permalink

    Since

    2.0.0

  18. implicit def newBoxedDoubleEncoder: Encoder[Double]

    Permalink

    Since

    2.0.0

  19. implicit def newBoxedFloatEncoder: Encoder[Float]

    Permalink

    Since

    2.0.0

  20. implicit def newBoxedIntEncoder: Encoder[Integer]

    Permalink

    Since

    2.0.0

  21. implicit def newBoxedLongEncoder: Encoder[Long]

    Permalink

    Since

    2.0.0

  22. implicit def newBoxedShortEncoder: Encoder[Short]

    Permalink

    Since

    2.0.0

  23. implicit def newByteArrayEncoder: Encoder[Array[Byte]]

    Permalink

    Since

    1.6.1

  24. implicit def newByteEncoder: Encoder[Byte]

    Permalink

    Since

    1.6.0

  25. implicit def newDateEncoder: Encoder[Date]

    Permalink

    Since

    2.2.0

  26. implicit def newDoubleArrayEncoder: Encoder[Array[Double]]

    Permalink

    Since

    1.6.1

  27. implicit def newDoubleEncoder: Encoder[Double]

    Permalink

    Since

    1.6.0

  28. implicit def newFloatArrayEncoder: Encoder[Array[Float]]

    Permalink

    Since

    1.6.1

  29. implicit def newFloatEncoder: Encoder[Float]

    Permalink

    Since

    1.6.0

  30. implicit def newIntArrayEncoder: Encoder[Array[Int]]

    Permalink

    Since

    1.6.1

  31. implicit def newIntEncoder: Encoder[Int]

    Permalink

    Since

    1.6.0

  32. implicit def newJavaDecimalEncoder: Encoder[BigDecimal]

    Permalink

    Since

    2.2.0

  33. implicit def newLongArrayEncoder: Encoder[Array[Long]]

    Permalink

    Since

    1.6.1

  34. implicit def newLongEncoder: Encoder[Long]

    Permalink

    Since

    1.6.0

  35. implicit def newMapEncoder[T <: Map[_, _]](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    Permalink

    Since

    2.3.0

  36. implicit def newProductArrayEncoder[A <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A]): Encoder[Array[A]]

    Permalink

    Since

    1.6.1

  37. implicit def newProductEncoder[T <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    Permalink

    Definition Classes
    LowPrioritySQLImplicits
    Since

    1.6.0

  38. implicit def newScalaDecimalEncoder: Encoder[BigDecimal]

    Permalink

    Since

    2.2.0

  39. implicit def newSequenceEncoder[T <: Seq[_]](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    Permalink

    Since

    2.2.0

  40. implicit def newSetEncoder[T <: Set[_]](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    Permalink

    Notice that we serialize Set to Catalyst array.

    Notice that we serialize Set to Catalyst array. The set property is only kept when manipulating the domain objects. The serialization format doesn't keep the set property. When we have a Catalyst array which contains duplicated elements and convert it to Dataset[Set[T]] by using the encoder, the elements will be de-duplicated.

    Since

    2.3.0

  41. implicit def newShortArrayEncoder: Encoder[Array[Short]]

    Permalink

    Since

    1.6.1

  42. implicit def newShortEncoder: Encoder[Short]

    Permalink

    Since

    1.6.0

  43. implicit def newStringArrayEncoder: Encoder[Array[String]]

    Permalink

    Since

    1.6.1

  44. implicit def newStringEncoder: Encoder[String]

    Permalink

    Since

    1.6.0

  45. implicit def newTimeStampEncoder: Encoder[Timestamp]

    Permalink

    Since

    2.2.0

  46. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  47. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  48. implicit def rddToDatasetHolder[T](rdd: RDD[T])(implicit arg0: Encoder[T]): DatasetHolder[T]

    Permalink

    Creates a Dataset from an RDD.

    Creates a Dataset from an RDD.

    Since

    1.6.0

  49. implicit def symbolToColumn(s: Symbol): ColumnName

    Permalink

    An implicit conversion that turns a Scala Symbol into a Column.

    An implicit conversion that turns a Scala Symbol into a Column.

    Since

    1.3.0

  50. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  51. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  52. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  53. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  54. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def newBooleanSeqEncoder: Encoder[Seq[Boolean]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

  2. def newByteSeqEncoder: Encoder[Seq[Byte]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

  3. def newDoubleSeqEncoder: Encoder[Seq[Double]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

  4. def newFloatSeqEncoder: Encoder[Seq[Float]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

  5. def newIntSeqEncoder: Encoder[Seq[Int]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

  6. def newLongSeqEncoder: Encoder[Seq[Long]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

  7. def newProductSeqEncoder[A <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A]): Encoder[Seq[A]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

  8. def newShortSeqEncoder: Encoder[Seq[Short]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

  9. def newStringSeqEncoder: Encoder[Seq[String]]

    Permalink

    Deprecated

    use newSequenceEncoder

    Since

    1.6.1

Inherited from LowPrioritySQLImplicits

Inherited from AnyRef

Inherited from Any

Ungrouped