Packages

c

org.apache.spark.sql

SQLImplicits

abstract class SQLImplicits extends LowPrioritySQLImplicits

A collection of implicit methods for converting common Scala objects into Datasets.

Source
SQLImplicits.scala
Since

1.6.0

Linear Supertypes
LowPrioritySQLImplicits, AnyRef, Any
Known Subclasses
implicits, implicits
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SQLImplicits
  2. LowPrioritySQLImplicits
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new SQLImplicits()

Type Members

  1. implicit class StringToColumn extends AnyRef

    Converts $"col name" into a Column.

    Converts $"col name" into a Column.

    Since

    2.0.0

Abstract Value Members

  1. abstract def session: SparkSession
    Attributes
    protected

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  8. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  9. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  10. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  11. implicit def localSeqToDatasetHolder[T](s: Seq[T])(implicit arg0: Encoder[T]): DatasetHolder[T]

    Creates a Dataset from a local Seq.

    Creates a Dataset from a local Seq.

    Since

    1.6.0

  12. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. implicit def newBooleanArrayEncoder: Encoder[Array[Boolean]]

    Since

    1.6.1

  14. implicit def newBooleanEncoder: Encoder[Boolean]

    Since

    1.6.0

  15. implicit def newBoxedBooleanEncoder: Encoder[Boolean]

    Since

    2.0.0

  16. implicit def newBoxedByteEncoder: Encoder[Byte]

    Since

    2.0.0

  17. implicit def newBoxedDoubleEncoder: Encoder[Double]

    Since

    2.0.0

  18. implicit def newBoxedFloatEncoder: Encoder[Float]

    Since

    2.0.0

  19. implicit def newBoxedIntEncoder: Encoder[Integer]

    Since

    2.0.0

  20. implicit def newBoxedLongEncoder: Encoder[Long]

    Since

    2.0.0

  21. implicit def newBoxedShortEncoder: Encoder[Short]

    Since

    2.0.0

  22. implicit def newByteArrayEncoder: Encoder[Array[Byte]]

    Since

    1.6.1

  23. implicit def newByteEncoder: Encoder[Byte]

    Since

    1.6.0

  24. implicit def newDateEncoder: Encoder[Date]

    Since

    2.2.0

  25. implicit def newDoubleArrayEncoder: Encoder[Array[Double]]

    Since

    1.6.1

  26. implicit def newDoubleEncoder: Encoder[Double]

    Since

    1.6.0

  27. implicit def newDurationEncoder: Encoder[Duration]

    Since

    3.2.0

  28. implicit def newFloatArrayEncoder: Encoder[Array[Float]]

    Since

    1.6.1

  29. implicit def newFloatEncoder: Encoder[Float]

    Since

    1.6.0

  30. implicit def newInstantEncoder: Encoder[Instant]

    Since

    3.0.0

  31. implicit def newIntArrayEncoder: Encoder[Array[Int]]

    Since

    1.6.1

  32. implicit def newIntEncoder: Encoder[Int]

    Since

    1.6.0

  33. implicit def newJavaDecimalEncoder: Encoder[BigDecimal]

    Since

    2.2.0

  34. implicit def newJavaEnumEncoder[A <: Enum[_]](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A]): Encoder[A]

    Since

    3.2.0

  35. implicit def newLocalDateEncoder: Encoder[LocalDate]

    Since

    3.0.0

  36. implicit def newLocalDateTimeEncoder: Encoder[LocalDateTime]

    Since

    3.4.0

  37. implicit def newLongArrayEncoder: Encoder[Array[Long]]

    Since

    1.6.1

  38. implicit def newLongEncoder: Encoder[Long]

    Since

    1.6.0

  39. implicit def newMapEncoder[T <: Map[_, _]](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    Since

    2.3.0

  40. implicit def newPeriodEncoder: Encoder[Period]

    Since

    3.2.0

  41. implicit def newProductArrayEncoder[A <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A]): Encoder[Array[A]]

    Since

    1.6.1

  42. implicit def newProductEncoder[T <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    Definition Classes
    LowPrioritySQLImplicits
    Since

    1.6.0

  43. implicit def newScalaDecimalEncoder: Encoder[BigDecimal]

    Since

    2.2.0

  44. implicit def newSequenceEncoder[T <: Seq[_]](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    Since

    2.2.0

  45. implicit def newSetEncoder[T <: Set[_]](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    Notice that we serialize Set to Catalyst array.

    Notice that we serialize Set to Catalyst array. The set property is only kept when manipulating the domain objects. The serialization format doesn't keep the set property. When we have a Catalyst array which contains duplicated elements and convert it to Dataset[Set[T]] by using the encoder, the elements will be de-duplicated.

    Since

    2.3.0

  46. implicit def newShortArrayEncoder: Encoder[Array[Short]]

    Since

    1.6.1

  47. implicit def newShortEncoder: Encoder[Short]

    Since

    1.6.0

  48. implicit def newStringArrayEncoder: Encoder[Array[String]]

    Since

    1.6.1

  49. implicit def newStringEncoder: Encoder[String]

    Since

    1.6.0

  50. implicit def newTimeStampEncoder: Encoder[Timestamp]

    Since

    2.2.0

  51. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  52. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  53. implicit def rddToDatasetHolder[T](rdd: RDD[T])(implicit arg0: Encoder[T]): DatasetHolder[T]

    Creates a Dataset from an RDD.

    Creates a Dataset from an RDD.

    Since

    1.6.0

  54. implicit def symbolToColumn(s: Symbol): ColumnName

    An implicit conversion that turns a Scala Symbol into a Column.

    An implicit conversion that turns a Scala Symbol into a Column.

    Since

    1.3.0

  55. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  56. def toString(): String
    Definition Classes
    AnyRef → Any
  57. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  58. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  59. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

  2. def newBooleanSeqEncoder: Encoder[Seq[Boolean]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

  3. def newByteSeqEncoder: Encoder[Seq[Byte]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

  4. def newDoubleSeqEncoder: Encoder[Seq[Double]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

  5. def newFloatSeqEncoder: Encoder[Seq[Float]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

  6. def newIntSeqEncoder: Encoder[Seq[Int]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

  7. def newLongSeqEncoder: Encoder[Seq[Long]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

  8. def newProductSeqEncoder[A <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A]): Encoder[Seq[A]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

  9. def newShortSeqEncoder: Encoder[Seq[Short]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

  10. def newStringSeqEncoder: Encoder[Seq[String]]

    Annotations
    @deprecated
    Deprecated

    (Since version 2.2.0) Use newSequenceEncoder instead

    Since

    1.6.1

Inherited from LowPrioritySQLImplicits

Inherited from AnyRef

Inherited from Any

Ungrouped