public class StorageListener
extends org.apache.spark.storage.BlockStatusListener
This class is thread-safe (unlike JobProgressListener)
Constructor and Description |
---|
StorageListener(StorageStatusListener storageStatusListener) |
Modifier and Type | Method and Description |
---|---|
scala.collection.Seq<StorageStatus> |
activeStorageStatusList() |
void |
onBlockUpdated(SparkListenerBlockUpdated blockUpdated) |
void |
onStageCompleted(SparkListenerStageCompleted stageCompleted) |
void |
onStageSubmitted(SparkListenerStageSubmitted stageSubmitted) |
void |
onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD) |
scala.collection.Seq<RDDInfo> |
rddInfoList()
Filter RDD info to include only those with cached partitions
|
public StorageListener(StorageStatusListener storageStatusListener)
public scala.collection.Seq<StorageStatus> activeStorageStatusList()
public scala.collection.Seq<RDDInfo> rddInfoList()
public void onStageSubmitted(SparkListenerStageSubmitted stageSubmitted)
public void onStageCompleted(SparkListenerStageCompleted stageCompleted)
public void onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)
public void onBlockUpdated(SparkListenerBlockUpdated blockUpdated)