org.apache.spark.sql

types

package types

Contains a type system for attributes produced by relations, including complex types like structs, arrays and maps.

Linear Supertypes
AnyRef, Any
Ordering
  1. Grouped
  2. Alphabetic
  3. By inheritance
Inherited
  1. types
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. case class ArrayType(elementType: DataType, containsNull: Boolean) extends DataType with Product with Serializable

    :: DeveloperApi :: The data type for collections of multiple values.

  2. class BinaryType extends NativeType with PrimitiveType

    :: DeveloperApi :: The data type representing Array[Byte] values.

  3. class BooleanType extends NativeType with PrimitiveType

    :: DeveloperApi :: The data type representing Boolean values.

  4. class ByteType extends IntegralType

    :: DeveloperApi :: The data type representing Byte values.

  5. abstract class DataType extends AnyRef

    :: DeveloperApi :: The base type of all Spark SQL data types.

  6. class DataTypes extends AnyRef

  7. class DateType extends NativeType

    :: DeveloperApi :: The data type representing java.sql.Date values.

  8. final class Decimal extends Ordered[Decimal] with Serializable

    A mutable implementation of BigDecimal that can hold a Long if values are small enough.

  9. case class DecimalType(precisionInfo: Option[PrecisionInfo]) extends FractionalType with Product with Serializable

    :: DeveloperApi :: The data type representing java.math.BigDecimal values.

  10. class DoubleType extends FractionalType

    :: DeveloperApi :: The data type representing Double values.

  11. class FloatType extends FractionalType

    :: DeveloperApi :: The data type representing Float values.

  12. sealed abstract class FractionalType extends NumericType

    Attributes
    protected[org.apache.spark.sql]
  13. class IntegerType extends IntegralType

    :: DeveloperApi :: The data type representing Int values.

  14. sealed abstract class IntegralType extends NumericType

    Attributes
    protected[org.apache.spark.sql]
  15. class LongType extends IntegralType

    :: DeveloperApi :: The data type representing Long values.

  16. case class MapType(keyType: DataType, valueType: DataType, valueContainsNull: Boolean) extends DataType with Product with Serializable

    :: DeveloperApi :: The data type for Maps.

  17. sealed class Metadata extends Serializable

    :: DeveloperApi ::

  18. class MetadataBuilder extends AnyRef

    :: DeveloperApi ::

  19. abstract class NativeType extends DataType

    Attributes
    protected[org.apache.spark.sql]
  20. class NullType extends DataType

    :: DeveloperApi :: The data type representing NULL values.

  21. abstract class NumericType extends NativeType with PrimitiveType

    :: DeveloperApi :: Numeric data types.

  22. case class PrecisionInfo(precision: Int, scale: Int) extends Product with Serializable

    Precision parameters for a Decimal

  23. trait PrimitiveType extends DataType

    Attributes
    protected[org.apache.spark.sql]
  24. class SQLUserDefinedType extends Annotation with Annotation with ClassfileAnnotation

  25. class ShortType extends IntegralType

    :: DeveloperApi :: The data type representing Short values.

  26. class StringType extends NativeType with PrimitiveType

    :: DeveloperApi :: The data type representing String values.

  27. case class StructField(name: String, dataType: DataType, nullable: Boolean = true, metadata: Metadata = Metadata.empty) extends Product with Serializable

    A field inside a StructType.

  28. case class StructType(fields: Array[StructField]) extends DataType with Seq[StructField] with Product with Serializable

    :: DeveloperApi :: A StructType object can be constructed by

  29. class TimestampType extends NativeType

    :: DeveloperApi :: The data type representing java.sql.Timestamp values.

  30. abstract class UserDefinedType[UserType] extends DataType with Serializable

    ::DeveloperApi:: The data type for User Defined Types (UDTs).

Value Members

  1. object ArrayType extends Serializable

  2. object BinaryType extends BinaryType with Product with Serializable

  3. object BooleanType extends BooleanType with Product with Serializable

  4. object ByteType extends ByteType with Product with Serializable

  5. object DataType

  6. object DateType extends DateType with Product with Serializable

  7. object DateUtils

    helper function to convert between Int value of days since 1970-01-01 and java.

  8. object Decimal extends Serializable

  9. object DecimalType extends Serializable

    Extra factory methods and pattern matchers for Decimals

  10. object DoubleType extends DoubleType with Product with Serializable

  11. object FloatType extends FloatType with Product with Serializable

  12. object FractionalType

    Matcher for any expressions that evaluate to FractionalTypes

  13. object IntegerType extends IntegerType with Product with Serializable

  14. object IntegralType

    Matcher for any expressions that evaluate to IntegralTypes

  15. object LongType extends LongType with Product with Serializable

  16. object MapType extends Serializable

  17. object Metadata extends Serializable

  18. object NativeType

    Attributes
    protected[org.apache.spark.sql]
  19. object NullType extends NullType with Product with Serializable

  20. object NumericType

    Attributes
    protected[org.apache.spark.sql]
  21. object PrimitiveType

    Attributes
    protected[org.apache.spark.sql]
  22. object ShortType extends ShortType with Product with Serializable

  23. object StringType extends StringType with Product with Serializable

  24. object StructType extends Serializable

  25. object TimestampType extends TimestampType with Product with Serializable

Inherited from AnyRef

Inherited from Any

Data types

Ungrouped