Packages

c

org.apache.spark.sql.streaming

StateOperatorProgress

class StateOperatorProgress extends Serializable

Information about updates made to stateful operators in a StreamingQuery during a trigger.

Annotations
@Evolving()
Source
progress.scala
Linear Supertypes
Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StateOperatorProgress
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. val allRemovalsTimeMs: Long
  2. val allUpdatesTimeMs: Long
  3. val commitTimeMs: Long
  4. val customMetrics: Map[String, Long]
  5. def json: String

    The compact JSON representation of this progress.

  6. val memoryUsedBytes: Long
  7. val numRowsDroppedByWatermark: Long
  8. val numRowsRemoved: Long
  9. val numRowsTotal: Long
  10. val numRowsUpdated: Long
  11. val numShufflePartitions: Long
  12. val numStateStoreInstances: Long
  13. val operatorName: String
  14. def prettyJson: String

    The pretty (i.e.

    The pretty (i.e. indented) JSON representation of this progress.

  15. def toString(): String
    Definition Classes
    StateOperatorProgress → AnyRef → Any