Package org.apache.spark

Class SpillListener

Object

org.apache.spark.scheduler.SparkListener

org.apache.spark.SpillListener

All Implemented Interfaces:

SparkListenerInterface

public class SpillListener
extends SparkListener

A SparkListener that detects whether spills have occurred in Spark jobs.

Constructor Summary

Constructors

Constructor	Description
SpillListener()

Method Summary

Modifier and Type	Method	Description
int	numSpilledStages()
void	onStageCompleted(SparkListenerStageCompleted stageComplete)	Called when a stage completes successfully or fails, with information on the completed stage.
void	onTaskEnd(SparkListenerTaskEnd taskEnd)	Called when a task ends

Methods inherited from class org.apache.spark.scheduler.SparkListener

onApplicationEnd, onApplicationStart, onBlockManagerAdded, onBlockManagerRemoved, onBlockUpdated, onEnvironmentUpdate, onExecutorAdded, onExecutorBlacklisted, onExecutorBlacklistedForStage, onExecutorExcluded, onExecutorExcludedForStage, onExecutorMetricsUpdate, onExecutorRemoved, onExecutorUnblacklisted, onExecutorUnexcluded, onJobEnd, onJobStart, onNodeBlacklisted, onNodeBlacklistedForStage, onNodeExcluded, onNodeExcludedForStage, onNodeUnblacklisted, onNodeUnexcluded, onOtherEvent, onResourceProfileAdded, onSpeculativeTaskSubmitted, onStageExecutorMetrics, onStageSubmitted, onTaskGettingResult, onTaskStart, onUnpersistRDD, onUnschedulableTaskSetAdded, onUnschedulableTaskSetRemoved

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SpillListener

public SpillListener()

Method Details

numSpilledStages

public int numSpilledStages()

onStageCompleted

public void onStageCompleted(SparkListenerStageCompleted stageComplete)

Description copied from interface: SparkListenerInterface

Called when a stage completes successfully or fails, with information on the completed stage.

Specified by:

onStageCompleted in interface SparkListenerInterface

Overrides:

onStageCompleted in class SparkListener

Parameters:

stageComplete - (undocumented)

onTaskEnd

public void onTaskEnd(SparkListenerTaskEnd taskEnd)

Description copied from interface: SparkListenerInterface

Called when a task ends

Specified by:

onTaskEnd in interface SparkListenerInterface

Overrides:

onTaskEnd in class SparkListener

Parameters:

taskEnd - (undocumented)