Object/Class

org.apache.spark.sql.types

DataType

Related Docs: class DataType | package types

Permalink

object DataType

Annotations
@Stable()
Source
DataType.scala
Since

1.3.0

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DataType
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def buildFormattedString(dataType: DataType, prefix: String, builder: StringBuilder): Unit

    Permalink
    Attributes
    protected[org.apache.spark.sql.types]
  6. def canWrite(write: DataType, read: DataType, resolver: Resolver, context: String, addError: (String) ⇒ Unit = (_: String) => {}): Boolean

    Permalink

    Returns true if the write data type can be read using the read data type.

    Returns true if the write data type can be read using the read data type.

    The write type is compatible with the read type if: - Both types are arrays, the array element types are compatible, and element nullability is compatible (read allows nulls or write does not contain nulls). - Both types are maps and the map key and value types are compatible, and value nullability is compatible (read allows nulls or write does not contain nulls). - Both types are structs and each field in the read struct is present in the write struct and compatible (including nullability), or is nullable if the write struct does not contain the field. Write-side structs are not compatible if they contain fields that are not present in the read-side struct. - Both types are atomic and the write type can be safely cast to the read type.

    Extra fields in write-side structs are not allowed to avoid accidentally writing data that the read schema will not read, and to ensure map key equality is not changed when data is read.

    write

    a write-side data type to validate against the read type

    read

    a read-side data type

    returns

    true if data written with the write type can be read using the read type

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  10. def equalsStructurally(from: DataType, to: DataType, ignoreNullability: Boolean = false): Boolean

    Permalink

    Returns true if the two data types share the same "shape", i.e.

    Returns true if the two data types share the same "shape", i.e. the types are the same, but the field names don't need to be the same.

    ignoreNullability

    whether to ignore nullability when comparing the types

  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. def fromDDL(ddl: String): DataType

    Permalink
  13. def fromJson(json: String): DataType

    Permalink
  14. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  15. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  16. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  17. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  18. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  19. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  20. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  21. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  22. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped