Packages

o

org.apache.spark.sql

Encoders

object Encoders

Methods for creating an Encoder.

Source
Encoders.scala
Since

1.6.0

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Encoders
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def BINARY: Encoder[Array[Byte]]

    An encoder for arrays of bytes.

    An encoder for arrays of bytes.

    Since

    1.6.1

  5. def BOOLEAN: Encoder[Boolean]

    An encoder for nullable boolean type.

    An encoder for nullable boolean type. The Scala primitive encoder is available as scalaBoolean.

    Since

    1.6.0

  6. def BYTE: Encoder[Byte]

    An encoder for nullable byte type.

    An encoder for nullable byte type. The Scala primitive encoder is available as scalaByte.

    Since

    1.6.0

  7. def DATE: Encoder[Date]

    An encoder for nullable date type.

    An encoder for nullable date type.

    Since

    1.6.0

  8. def DECIMAL: Encoder[BigDecimal]

    An encoder for nullable decimal type.

    An encoder for nullable decimal type.

    Since

    1.6.0

  9. def DOUBLE: Encoder[Double]

    An encoder for nullable double type.

    An encoder for nullable double type. The Scala primitive encoder is available as scalaDouble.

    Since

    1.6.0

  10. def DURATION: Encoder[Duration]

    Creates an encoder that serializes instances of the java.time.Duration class to the internal representation of nullable Catalyst's DayTimeIntervalType.

    Creates an encoder that serializes instances of the java.time.Duration class to the internal representation of nullable Catalyst's DayTimeIntervalType.

    Since

    3.2.0

  11. def FLOAT: Encoder[Float]

    An encoder for nullable float type.

    An encoder for nullable float type. The Scala primitive encoder is available as scalaFloat.

    Since

    1.6.0

  12. def INSTANT: Encoder[Instant]

    Creates an encoder that serializes instances of the java.time.Instant class to the internal representation of nullable Catalyst's TimestampType.

    Creates an encoder that serializes instances of the java.time.Instant class to the internal representation of nullable Catalyst's TimestampType.

    Since

    3.0.0

  13. def INT: Encoder[Integer]

    An encoder for nullable int type.

    An encoder for nullable int type. The Scala primitive encoder is available as scalaInt.

    Since

    1.6.0

  14. def LOCALDATE: Encoder[LocalDate]

    Creates an encoder that serializes instances of the java.time.LocalDate class to the internal representation of nullable Catalyst's DateType.

    Creates an encoder that serializes instances of the java.time.LocalDate class to the internal representation of nullable Catalyst's DateType.

    Since

    3.0.0

  15. def LOCALDATETIME: Encoder[LocalDateTime]

    Creates an encoder that serializes instances of the java.time.LocalDateTime class to the internal representation of nullable Catalyst's TimestampNTZType.

    Creates an encoder that serializes instances of the java.time.LocalDateTime class to the internal representation of nullable Catalyst's TimestampNTZType.

    Since

    3.4.0

  16. def LONG: Encoder[Long]

    An encoder for nullable long type.

    An encoder for nullable long type. The Scala primitive encoder is available as scalaLong.

    Since

    1.6.0

  17. def PERIOD: Encoder[Period]

    Creates an encoder that serializes instances of the java.time.Period class to the internal representation of nullable Catalyst's YearMonthIntervalType.

    Creates an encoder that serializes instances of the java.time.Period class to the internal representation of nullable Catalyst's YearMonthIntervalType.

    Since

    3.2.0

  18. def SHORT: Encoder[Short]

    An encoder for nullable short type.

    An encoder for nullable short type. The Scala primitive encoder is available as scalaShort.

    Since

    1.6.0

  19. def STRING: Encoder[String]

    An encoder for nullable string type.

    An encoder for nullable string type.

    Since

    1.6.0

  20. def TIMESTAMP: Encoder[Timestamp]

    An encoder for nullable timestamp type.

    An encoder for nullable timestamp type.

    Since

    1.6.0

  21. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  22. def bean[T](beanClass: Class[T]): Encoder[T]

    Creates an encoder for Java Bean of type T.

    Creates an encoder for Java Bean of type T.

    T must be publicly accessible.

    supported types for java bean field:

    • primitive types: boolean, int, double, etc.
    • boxed types: Boolean, Integer, Double, etc.
    • String
    • java.math.BigDecimal, java.math.BigInteger
    • time related: java.sql.Date, java.sql.Timestamp, java.time.LocalDate, java.time.Instant
    • collection types: array, java.util.List, and map
    • nested java bean.
    Since

    1.6.0

  23. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  24. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  25. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  26. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  27. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  28. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  29. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  30. def javaSerialization[T](clazz: Class[T]): Encoder[T]

    Creates an encoder that serializes objects of type T using generic Java serialization.

    Creates an encoder that serializes objects of type T using generic Java serialization. This encoder maps T into a single byte array (binary) field.

    T must be publicly accessible.

    Since

    1.6.0

    Note

    This is extremely inefficient and should only be used as the last resort.

  31. def javaSerialization[T](implicit arg0: ClassTag[T]): Encoder[T]

    (Scala-specific) Creates an encoder that serializes objects of type T using generic Java serialization.

    (Scala-specific) Creates an encoder that serializes objects of type T using generic Java serialization. This encoder maps T into a single byte array (binary) field.

    T must be publicly accessible.

    Since

    1.6.0

    Note

    This is extremely inefficient and should only be used as the last resort.

  32. def kryo[T](clazz: Class[T]): Encoder[T]

    Creates an encoder that serializes objects of type T using Kryo.

    Creates an encoder that serializes objects of type T using Kryo. This encoder maps T into a single byte array (binary) field.

    T must be publicly accessible.

    Since

    1.6.0

  33. def kryo[T](implicit arg0: ClassTag[T]): Encoder[T]

    (Scala-specific) Creates an encoder that serializes objects of type T using Kryo.

    (Scala-specific) Creates an encoder that serializes objects of type T using Kryo. This encoder maps T into a single byte array (binary) field.

    T must be publicly accessible.

    Since

    1.6.0

  34. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  35. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  36. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  37. def product[T <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): Encoder[T]

    An encoder for Scala's product type (tuples, case classes, etc).

    An encoder for Scala's product type (tuples, case classes, etc).

    Since

    2.0.0

  38. def row(schema: StructType): Encoder[Row]

    Creates a Row encoder for schema schema.

    Creates a Row encoder for schema schema.

    Since

    3.5.0

  39. def scalaBoolean: Encoder[Boolean]

    An encoder for Scala's primitive boolean type.

    An encoder for Scala's primitive boolean type.

    Since

    2.0.0

  40. def scalaByte: Encoder[Byte]

    An encoder for Scala's primitive byte type.

    An encoder for Scala's primitive byte type.

    Since

    2.0.0

  41. def scalaDouble: Encoder[Double]

    An encoder for Scala's primitive double type.

    An encoder for Scala's primitive double type.

    Since

    2.0.0

  42. def scalaFloat: Encoder[Float]

    An encoder for Scala's primitive float type.

    An encoder for Scala's primitive float type.

    Since

    2.0.0

  43. def scalaInt: Encoder[Int]

    An encoder for Scala's primitive int type.

    An encoder for Scala's primitive int type.

    Since

    2.0.0

  44. def scalaLong: Encoder[Long]

    An encoder for Scala's primitive long type.

    An encoder for Scala's primitive long type.

    Since

    2.0.0

  45. def scalaShort: Encoder[Short]

    An encoder for Scala's primitive short type.

    An encoder for Scala's primitive short type.

    Since

    2.0.0

  46. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  47. def toString(): String
    Definition Classes
    AnyRef → Any
  48. def tuple[T1, T2, T3, T4, T5](e1: Encoder[T1], e2: Encoder[T2], e3: Encoder[T3], e4: Encoder[T4], e5: Encoder[T5]): Encoder[(T1, T2, T3, T4, T5)]

    An encoder for 5-ary tuples.

    An encoder for 5-ary tuples.

    Since

    1.6.0

  49. def tuple[T1, T2, T3, T4](e1: Encoder[T1], e2: Encoder[T2], e3: Encoder[T3], e4: Encoder[T4]): Encoder[(T1, T2, T3, T4)]

    An encoder for 4-ary tuples.

    An encoder for 4-ary tuples.

    Since

    1.6.0

  50. def tuple[T1, T2, T3](e1: Encoder[T1], e2: Encoder[T2], e3: Encoder[T3]): Encoder[(T1, T2, T3)]

    An encoder for 3-ary tuples.

    An encoder for 3-ary tuples.

    Since

    1.6.0

  51. def tuple[T1, T2](e1: Encoder[T1], e2: Encoder[T2]): Encoder[(T1, T2)]

    An encoder for 2-ary tuples.

    An encoder for 2-ary tuples.

    Since

    1.6.0

  52. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  53. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  54. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped