types

Type Members

1. case class ArrayType(elementType: DataType, containsNull: Boolean) extends DataType with Product with Serializable

   :: DeveloperApi :: The data type for collections of multiple values.

2. abstract class AtomicType extends DataType

   An internal type used to represent everything that is not null, UDTs, arrays, structs, and maps.

3. class BinaryType extends AtomicType

   :: DeveloperApi :: The data type representing Array[Byte] values.

4. class BooleanType extends AtomicType

   :: DeveloperApi :: The data type representing Boolean values.

5. class ByteType extends IntegralType

   :: DeveloperApi :: The data type representing Byte values.

6. abstract class DataType extends AnyRef

   :: DeveloperApi :: The base type of all Spark SQL data types.

7. class DataTypes extends AnyRef

8. class DateType extends AtomicType

   :: DeveloperApi :: The data type representing java.sql.Date values.

9. final class Decimal extends Ordered[Decimal] with Serializable

   A mutable implementation of BigDecimal that can hold a Long if values are small enough.

10. case class DecimalType(precisionInfo: Option[PrecisionInfo]) extends FractionalType with Product with Serializable

    :: DeveloperApi :: The data type representing java.math.BigDecimal values.

11. class DoubleType extends FractionalType

    :: DeveloperApi :: The data type representing Double values.

12. class FloatType extends FractionalType

    :: DeveloperApi :: The data type representing Float values.

13. class IntegerType extends IntegralType

    :: DeveloperApi :: The data type representing Int values.

14. class LongType extends IntegralType

    :: DeveloperApi :: The data type representing Long values.

15. case class MapType(keyType: DataType, valueType: DataType, valueContainsNull: Boolean) extends DataType with Product with Serializable

    :: DeveloperApi :: The data type for Maps.

16. sealed class Metadata extends Serializable

    :: DeveloperApi ::

17. class MetadataBuilder extends AnyRef

    :: DeveloperApi ::

18. class NullType extends DataType

    :: DeveloperApi :: The data type representing NULL values.

19. abstract class NumericType extends AtomicType

    :: DeveloperApi :: Numeric data types.

20. case class PrecisionInfo(precision: Int, scale: Int) extends Product with Serializable

    Precision parameters for a Decimal

21. class SQLUserDefinedType extends Annotation with Annotation with ClassfileAnnotation

22. class ShortType extends IntegralType

    :: DeveloperApi :: The data type representing Short values.

23. class StringType extends AtomicType

    :: DeveloperApi :: The data type representing String values.

24. case class StructField(name: String, dataType: DataType, nullable: Boolean = true, metadata: Metadata = Metadata.empty) extends Product with Serializable

    A field inside a StructType.

25. case class StructType(fields: Array[StructField]) extends DataType with Seq[StructField] with Product with Serializable

    :: DeveloperApi :: A StructType object can be constructed by

26. class TimestampType extends AtomicType

    :: DeveloperApi :: The data type representing java.sql.Timestamp values.

27. final class UTF8String extends Ordered[UTF8String] with Serializable

    :: DeveloperApi :: A UTF-8 String, as internal representation of StringType in SparkSQL

28. abstract class UserDefinedType[UserType] extends DataType with Serializable

    ::DeveloperApi:: The data type for User Defined Types (UDTs).