|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
Object org.apache.spark.storage.StorageStatusListener
public class StorageStatusListener
:: DeveloperApi :: A SparkListener that maintains executor storage status.
This class is thread-safe (unlike JobProgressListener)
Constructor Summary | |
---|---|
StorageStatusListener()
|
Method Summary | |
---|---|
scala.collection.mutable.Map<String,StorageStatus> |
executorIdToStorageStatus()
|
void |
onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded)
Called when a new block manager has joined |
void |
onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved)
Called when an existing block manager has been removed |
void |
onTaskEnd(SparkListenerTaskEnd taskEnd)
Called when a task ends |
void |
onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)
Called when an RDD is manually unpersisted by the application |
scala.collection.Seq<StorageStatus> |
storageStatusList()
|
Methods inherited from class Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Methods inherited from interface org.apache.spark.scheduler.SparkListener |
---|
onApplicationEnd, onApplicationStart, onEnvironmentUpdate, onExecutorAdded, onExecutorMetricsUpdate, onExecutorRemoved, onJobEnd, onJobStart, onStageCompleted, onStageSubmitted, onTaskGettingResult, onTaskStart |
Constructor Detail |
---|
public StorageStatusListener()
Method Detail |
---|
public scala.collection.mutable.Map<String,StorageStatus> executorIdToStorageStatus()
public scala.collection.Seq<StorageStatus> storageStatusList()
public void onTaskEnd(SparkListenerTaskEnd taskEnd)
SparkListener
onTaskEnd
in interface SparkListener
taskEnd
- (undocumented)public void onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)
SparkListener
onUnpersistRDD
in interface SparkListener
unpersistRDD
- (undocumented)public void onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded)
SparkListener
onBlockManagerAdded
in interface SparkListener
blockManagerAdded
- (undocumented)public void onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved)
SparkListener
onBlockManagerRemoved
in interface SparkListener
blockManagerRemoved
- (undocumented)
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |