pyspark.sql.DataFrame.unpersist

DataFrame.unpersist(blocking: bool = False) → pyspark.sql.dataframe.DataFrame

Marks the DataFrame as non-persistent, and remove all blocks for it from memory and disk.

New in version 1.3.0.

Notes

blocking default has changed to False to match Scala in 2.0.

pyspark.sql.DataFrame.unionByName pyspark.sql.DataFrame.where