public class SpillListener extends SparkListener
SparkListener
that detects whether spills have occurred in Spark jobs.Constructor and Description |
---|
SpillListener() |
Modifier and Type | Method and Description |
---|---|
int |
numSpilledStages() |
void |
onJobEnd(SparkListenerJobEnd jobEnd)
Called when a job ends
|
void |
onStageCompleted(SparkListenerStageCompleted stageComplete)
Called when a stage completes successfully or fails, with information on the completed stage.
|
void |
onTaskEnd(SparkListenerTaskEnd taskEnd)
Called when a task ends
|
onApplicationEnd, onApplicationStart, onBlockManagerAdded, onBlockManagerRemoved, onBlockUpdated, onEnvironmentUpdate, onExecutorAdded, onExecutorBlacklisted, onExecutorMetricsUpdate, onExecutorRemoved, onExecutorUnblacklisted, onJobStart, onNodeBlacklisted, onNodeUnblacklisted, onOtherEvent, onSpeculativeTaskSubmitted, onStageSubmitted, onTaskGettingResult, onTaskStart, onUnpersistRDD
public int numSpilledStages()
public void onTaskEnd(SparkListenerTaskEnd taskEnd)
onTaskEnd
in class SparkListener
taskEnd
- (undocumented)public void onStageCompleted(SparkListenerStageCompleted stageComplete)
onStageCompleted
in class SparkListener
stageComplete
- (undocumented)public void onJobEnd(SparkListenerJobEnd jobEnd)
onJobEnd
in class SparkListener
jobEnd
- (undocumented)