pyspark.sql.streaming.StreamingQuery.lastProgress

property StreamingQuery.lastProgress

Returns the most recent StreamingQueryProgress update of this streaming query or None if there were no progress updates

New in version 2.1.0.

Changed in version 3.5.0: Supports Spark Connect.

Returns

dict, optional

The most recent StreamingQueryProgress update of this streaming query or None if there were no progress updates.

Examples

>>> sdf = spark.readStream.format("rate").load()
>>> sq = sdf.writeStream.format('memory').queryName('this_query').start()

Get the most recent query progress updates for this query

>>> sq.lastProgress
>>> sq.stop()

previous

pyspark.sql.streaming.StreamingQuery.isActive

next

pyspark.sql.streaming.StreamingQuery.name