pyspark.sql.conf.RuntimeConfig

class pyspark.sql.conf.RuntimeConfig(jconf)

User-facing configuration API, accessible through SparkSession.conf.

Options set here are automatically propagated to the Hadoop configuration during I/O.

Changed in version 3.4.0: Supports Spark Connect.

Methods

get(key[, default])	Returns the value of Spark runtime configuration property for the given key, assuming it is set.
isModifiable(key)	Indicates whether the configuration property with the given key is modifiable in the current session.
set(key, value)	Sets the given Spark runtime configuration property.
unset(key)	Resets the configuration property for the given key.

Attributes

getAll

Returns all properties set in this conf.