public class SpillListener extends SparkListener
SparkListener
that detects whether spills have occurred in Spark jobs.Constructor and Description |
---|
SpillListener() |
Modifier and Type | Method and Description |
---|---|
int |
numSpilledStages() |
void |
onStageCompleted(SparkListenerStageCompleted stageComplete)
Called when a stage completes successfully or fails, with information on the completed stage.
|
void |
onTaskEnd(SparkListenerTaskEnd taskEnd)
Called when a task ends
|
onApplicationEnd, onApplicationStart, onBlockManagerAdded, onBlockManagerRemoved, onBlockUpdated, onEnvironmentUpdate, onExecutorAdded, onExecutorBlacklisted, onExecutorBlacklistedForStage, onExecutorMetricsUpdate, onExecutorRemoved, onExecutorUnblacklisted, onJobEnd, onJobStart, onNodeBlacklisted, onNodeBlacklistedForStage, onNodeUnblacklisted, onOtherEvent, onSpeculativeTaskSubmitted, onStageSubmitted, onTaskGettingResult, onTaskStart, onUnpersistRDD
public int numSpilledStages()
public void onStageCompleted(SparkListenerStageCompleted stageComplete)
SparkListenerInterface
onStageCompleted
in interface SparkListenerInterface
onStageCompleted
in class SparkListener
stageComplete
- (undocumented)public void onTaskEnd(SparkListenerTaskEnd taskEnd)
SparkListenerInterface
onTaskEnd
in interface SparkListenerInterface
onTaskEnd
in class SparkListener
taskEnd
- (undocumented)