object functions
- Source
- functions.scala
- Alphabetic
- By Inheritance
- functions
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
def
from_avro(data: Column, jsonFormatSchema: String, options: Map[String, String]): Column
Converts a binary column of Avro format into its corresponding catalyst value.
Converts a binary column of Avro format into its corresponding catalyst value. The specified schema must match actual schema of the read data, otherwise the behavior is undefined: it may fail or return arbitrary result. To deserialize the data with a compatible and evolved schema, the expected Avro schema can be set via the option avroSchema.
- data
the binary column.
- jsonFormatSchema
the avro schema in JSON string format.
- options
options to control how the Avro record is parsed.
- Annotations
- @Experimental()
- Since
3.0.0
-
def
from_avro(data: Column, jsonFormatSchema: String): Column
Converts a binary column of avro format into its corresponding catalyst value.
Converts a binary column of avro format into its corresponding catalyst value. The specified schema must match the read data, otherwise the behavior is undefined: it may fail or return arbitrary result.
- data
the binary column.
- jsonFormatSchema
the avro schema in JSON string format.
- Annotations
- @Experimental()
- Since
3.0.0
-
def
to_avro(data: Column, jsonFormatSchema: String): Column
Converts a column into binary of avro format.
Converts a column into binary of avro format.
- data
the data column.
- jsonFormatSchema
user-specified output avro schema in JSON string format.
- Annotations
- @Experimental()
- Since
3.0.0
-
def
to_avro(data: Column): Column
Converts a column into binary of avro format.
Converts a column into binary of avro format.
- data
the data column.
- Annotations
- @Experimental()
- Since
3.0.0