pyspark.sql.SparkSession.getActiveSession¶

classmethod SparkSession.getActiveSession() → Optional[pyspark.sql.session.SparkSession][source]¶

Returns the active SparkSession for the current thread, returned by the builder

New in version 3.0.0.

Changed in version 3.5.0: Supports Spark Connect.

Returns

SparkSession: Spark session if an active session exists for the current thread

Examples

>>> s = SparkSession.getActiveSession()
>>> df = s.createDataFrame([('Alice', 1)], ['name', 'age'])
>>> df.select("age").show()
+---+
|age|
+---+
|  1|
+---+

pyspark.sql.SparkSession.createDataFrame

pyspark.sql.SparkSession.newSession