org.apache.spark.sql

types

package types

Contains a type system for attributes produced by relations, including complex types like structs, arrays and maps.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. types
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. class ArrayBasedMapData extends MapData

  2. abstract class ArrayData extends SpecializedGetters with Serializable

  3. case class ArrayType(elementType: DataType, containsNull: Boolean) extends DataType with Product with Serializable

    :: DeveloperApi :: The data type for collections of multiple values.

  4. abstract class AtomicType extends DataType

    An internal type used to represent everything that is not null, UDTs, arrays, structs, and maps.

  5. class BinaryType extends AtomicType

    :: DeveloperApi :: The data type representing Array[Byte] values.

  6. class BooleanType extends AtomicType

    :: DeveloperApi :: The data type representing Boolean values.

  7. class ByteType extends IntegralType

    :: DeveloperApi :: The data type representing Byte values.

  8. class CalendarIntervalType extends DataType

    :: DeveloperApi :: The data type representing calendar time intervals.

  9. abstract class DataType extends AbstractDataType

    :: DeveloperApi :: The base type of all Spark SQL data types.

  10. class DataTypes extends AnyRef

  11. class DateType extends AtomicType

    :: DeveloperApi :: A date type, supporting "0001-01-01" through "9999-12-31".

  12. final class Decimal extends Ordered[Decimal] with Serializable

    A mutable implementation of BigDecimal that can hold a Long if values are small enough.

  13. case class DecimalType(precision: Int, scale: Int) extends FractionalType with Product with Serializable

    :: DeveloperApi :: The data type representing java.math.BigDecimal values.

  14. class DoubleType extends FractionalType

    :: DeveloperApi :: The data type representing Double values.

  15. class FloatType extends FractionalType

    :: DeveloperApi :: The data type representing Float values.

  16. class GenericArrayData extends ArrayData

  17. class IntegerType extends IntegralType

    :: DeveloperApi :: The data type representing Int values.

  18. class LongType extends IntegralType

    :: DeveloperApi :: The data type representing Long values.

  19. abstract class MapData extends Serializable

  20. case class MapType(keyType: DataType, valueType: DataType, valueContainsNull: Boolean) extends DataType with Product with Serializable

    :: DeveloperApi :: The data type for Maps.

  21. sealed class Metadata extends Serializable

    :: DeveloperApi ::

  22. class MetadataBuilder extends AnyRef

    :: DeveloperApi ::

  23. class NullType extends DataType

    :: DeveloperApi :: The data type representing NULL values.

  24. abstract class NumericType extends AtomicType

    :: DeveloperApi :: Numeric data types.

  25. class SQLUserDefinedType extends Annotation with Annotation with ClassfileAnnotation

  26. class ShortType extends IntegralType

    :: DeveloperApi :: The data type representing Short values.

  27. class StringType extends AtomicType

    :: DeveloperApi :: The data type representing String values.

  28. case class StructField(name: String, dataType: DataType, nullable: Boolean = true, metadata: Metadata = Metadata.empty) extends Product with Serializable

    A field inside a StructType.

  29. case class StructType(fields: Array[StructField]) extends DataType with Seq[StructField] with Product with Serializable

    :: DeveloperApi :: A StructType object can be constructed by

  30. class TimestampType extends AtomicType

    :: DeveloperApi :: The data type representing java.sql.Timestamp values.

  31. abstract class UserDefinedType[UserType] extends DataType with Serializable

    ::DeveloperApi:: The data type for User Defined Types (UDTs).

  32. case class PrecisionInfo(precision: Int, scale: Int) extends Product with Serializable

    Precision parameters for a Decimal

Value Members

  1. object AnyDataType extends AbstractDataType

    An AbstractDataType that matches any concrete data types.

  2. object ArrayBasedMapData extends Serializable

  3. object ArrayType extends AbstractDataType with Serializable

  4. object BinaryType extends BinaryType with Product with Serializable

  5. object BooleanType extends BooleanType with Product with Serializable

  6. object ByteType extends ByteType with Product with Serializable

  7. object CalendarIntervalType extends CalendarIntervalType with Product with Serializable

  8. object DataType

  9. object DateType extends DateType with Product with Serializable

  10. object Decimal extends Serializable

  11. object DecimalType extends AbstractDataType with Serializable

    Extra factory methods and pattern matchers for Decimals

  12. object DoubleType extends DoubleType with Product with Serializable

  13. object FloatType extends FloatType with Product with Serializable

  14. object IntegerType extends IntegerType with Product with Serializable

  15. object LongType extends LongType with Product with Serializable

  16. object MapType extends AbstractDataType with Serializable

  17. object Metadata extends Serializable

  18. object NullType extends NullType with Product with Serializable

  19. object ShortType extends ShortType with Product with Serializable

  20. object StringType extends StringType with Product with Serializable

  21. object StructType extends AbstractDataType with Serializable

  22. object TimestampType extends TimestampType with Product with Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped