org.apache.spark.sql

types

package types

Contains a type system for attributes produced by relations, including complex types like structs, arrays and maps.

Source
package.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. types
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. case class ArrayType(elementType: DataType, containsNull: Boolean) extends DataType with Product with Serializable

    :: DeveloperApi :: The data type for collections of multiple values.

  2. abstract class AtomicType extends DataType

    An internal type used to represent everything that is not null, UDTs, arrays, structs, and maps.

  3. class BinaryType extends AtomicType

    :: DeveloperApi :: The data type representing Array[Byte] values.

  4. class BooleanType extends AtomicType

    :: DeveloperApi :: The data type representing Boolean values.

  5. class ByteType extends IntegralType

    :: DeveloperApi :: The data type representing Byte values.

  6. class CalendarIntervalType extends DataType

    :: DeveloperApi :: The data type representing calendar time intervals.

  7. abstract class DataType extends AbstractDataType

    :: DeveloperApi :: The base type of all Spark SQL data types.

  8. class DataTypes extends AnyRef

  9. class DateType extends AtomicType

    :: DeveloperApi :: A date type, supporting "0001-01-01" through "9999-12-31".

  10. final class Decimal extends Ordered[Decimal] with Serializable

    A mutable implementation of BigDecimal that can hold a Long if values are small enough.

  11. case class DecimalType(precision: Int, scale: Int) extends FractionalType with Product with Serializable

    :: DeveloperApi :: The data type representing java.math.BigDecimal values.

  12. class DoubleType extends FractionalType

    :: DeveloperApi :: The data type representing Double values.

  13. class FloatType extends FractionalType

    :: DeveloperApi :: The data type representing Float values.

  14. class IntegerType extends IntegralType

    :: DeveloperApi :: The data type representing Int values.

  15. class LongType extends IntegralType

    :: DeveloperApi :: The data type representing Long values.

  16. case class MapType(keyType: DataType, valueType: DataType, valueContainsNull: Boolean) extends DataType with Product with Serializable

    :: DeveloperApi :: The data type for Maps.

  17. sealed class Metadata extends Serializable

    :: DeveloperApi ::

  18. class MetadataBuilder extends AnyRef

    :: DeveloperApi ::

  19. class NullType extends DataType

    :: DeveloperApi :: The data type representing NULL values.

  20. abstract class NumericType extends AtomicType

    :: DeveloperApi :: Numeric data types.

  21. class SQLUserDefinedType extends Annotation with Annotation with ClassfileAnnotation

  22. class ShortType extends IntegralType

    :: DeveloperApi :: The data type representing Short values.

  23. class StringType extends AtomicType

    :: DeveloperApi :: The data type representing String values.

  24. case class StructField(name: String, dataType: DataType, nullable: Boolean = true, metadata: Metadata = Metadata.empty) extends Product with Serializable

    A field inside a StructType.

  25. case class StructType(fields: Array[StructField]) extends DataType with Seq[StructField] with Product with Serializable

    :: DeveloperApi :: A StructType object can be constructed by

  26. class TimestampType extends AtomicType

    :: DeveloperApi :: The data type representing java.sql.Timestamp values.

  27. abstract class UserDefinedType[UserType] extends DataType with Serializable

    ::DeveloperApi:: The data type for User Defined Types (UDTs).

  28. case class PrecisionInfo(precision: Int, scale: Int) extends Product with Serializable

    Precision parameters for a Decimal

Value Members

  1. object AnyDataType extends AbstractDataType

    An AbstractDataType that matches any concrete data types.

  2. object ArrayType extends AbstractDataType with Serializable

  3. object BinaryType extends BinaryType with Product with Serializable

  4. object BooleanType extends BooleanType with Product with Serializable

  5. object ByteType extends ByteType with Product with Serializable

  6. object CalendarIntervalType extends CalendarIntervalType with Product with Serializable

  7. object DataType

  8. object DateType extends DateType with Product with Serializable

  9. object Decimal extends Serializable

  10. object DecimalType extends AbstractDataType with Serializable

    Extra factory methods and pattern matchers for Decimals

  11. object DoubleType extends DoubleType with Product with Serializable

  12. object FloatType extends FloatType with Product with Serializable

  13. object IntegerType extends IntegerType with Product with Serializable

  14. object LongType extends LongType with Product with Serializable

  15. object MapType extends AbstractDataType with Serializable

  16. object Metadata extends Serializable

  17. object NullType extends NullType with Product with Serializable

  18. object ShortType extends ShortType with Product with Serializable

  19. object StringType extends StringType with Product with Serializable

  20. object StructType extends AbstractDataType with Serializable

  21. object TimestampType extends TimestampType with Product with Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped