org.apache.spark.sql.streaming

Class StateOperatorProgress

Object

org.apache.spark.sql.streaming.StateOperatorProgress

All Implemented Interfaces:

java.io.Serializable

public class StateOperatorProgress
extends Object
implements scala.Serializable

Information about updates made to stateful operators in a StreamingQuery during a trigger.

See Also:

Serialized Form

Method Summary

Modifier and Type	Method and Description
long	allRemovalsTimeMs()
long	allUpdatesTimeMs()
long	commitTimeMs()
java.util.Map<String,Long>	customMetrics()
String	json() The compact JSON representation of this progress.
long	memoryUsedBytes()
long	numRowsDroppedByWatermark()
long	numRowsRemoved()
long	numRowsTotal()
long	numRowsUpdated()
long	numShufflePartitions()
long	numStateStoreInstances()
String	operatorName()
String	prettyJson() The pretty (i.e.
String	toString()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

operatorName

public String operatorName()

numRowsTotal

public long numRowsTotal()

numRowsUpdated

public long numRowsUpdated()

allUpdatesTimeMs

public long allUpdatesTimeMs()

numRowsRemoved

public long numRowsRemoved()

allRemovalsTimeMs

public long allRemovalsTimeMs()

commitTimeMs

public long commitTimeMs()

memoryUsedBytes

public long memoryUsedBytes()

numRowsDroppedByWatermark

public long numRowsDroppedByWatermark()

numShufflePartitions

public long numShufflePartitions()

numStateStoreInstances

public long numStateStoreInstances()

customMetrics

public java.util.Map<String,Long> customMetrics()

json

public String json()

The compact JSON representation of this progress.

prettyJson

public String prettyJson()

The pretty (i.e. indented) JSON representation of this progress.

toString

public String toString()

Overrides:

toString in class Object