pyspark.sql.DataFrame.storageLevel

property DataFrame.storageLevel

Get the DataFrame’s current storage level.

New in version 2.1.0.

Changed in version 3.4.0: Supports Spark Connect.

Returns

StorageLevel

Currently defined storage level.

Examples

>>> df1 = spark.range(10)
>>> df1.storageLevel
StorageLevel(False, False, False, False, 1)
>>> df1.cache().storageLevel
StorageLevel(True, True, False, True, 1)

>>> df2 = spark.range(5)
>>> df2.persist(StorageLevel.DISK_ONLY_2).storageLevel
StorageLevel(True, False, False, False, 2)

previous

pyspark.sql.DataFrame.stat

next

pyspark.sql.DataFrame.subtract