package avro
- Source
- package.scala
- Alphabetic
- By Inheritance
- avro
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Type Members
- sealed final class AvroCompressionCodec extends Enum[AvroCompressionCodec]
A mapper class from Spark supported avro compression codecs to avro compression codecs.
Value Members
- object SchemaConverters
This object contains method that are used to convert sparkSQL schemas to avro schemas and vice versa.
This object contains method that are used to convert sparkSQL schemas to avro schemas and vice versa.
- Annotations
- @DeveloperApi()
- object functions
Deprecated Value Members
- def from_avro(data: Column, jsonFormatSchema: String): Column
Converts a binary column of avro format into its corresponding catalyst value.
Converts a binary column of avro format into its corresponding catalyst value. The specified schema must match the read data, otherwise the behavior is undefined: it may fail or return arbitrary result.
- data
the binary column.
- jsonFormatSchema
the avro schema in JSON string format.
- Annotations
- @deprecated
- Deprecated
(Since version 3.0.0) Please use 'org.apache.spark.sql.avro.functions.from_avro' instead.
- Since
2.4.0
- def to_avro(data: Column): Column
Converts a column into binary of avro format.
Converts a column into binary of avro format.
- data
the data column.
- Annotations
- @deprecated
- Deprecated
(Since version 3.0.0) Please use 'org.apache.spark.sql.avro.functions.to_avro' instead.
- Since
2.4.0