pyspark.sql.functions.to_csv

pyspark.sql.functions.to_csv(col, options={})[source]

Converts a column containing a StructType into a CSV string. Throws an exception, in the case of an unsupported type.

New in version 3.0.0.

Parameters
colColumn or str

name of column containing a struct.

options: dict, optional

options to control converting. accepts the same options as the CSV datasource.

Examples

>>> from pyspark.sql import Row
>>> data = [(1, Row(age=2, name='Alice'))]
>>> df = spark.createDataFrame(data, ("key", "value"))
>>> df.select(to_csv(df.value).alias("csv")).collect()
[Row(csv='2,Alice')]