org.apache.spark.scheduler

Class JobWaiter<T>

Object

org.apache.spark.scheduler.JobWaiter<T>

All Implemented Interfaces:

JobListener

public class JobWaiter<T>
extends Object
implements JobListener

An object that waits for a DAGScheduler job to complete. As tasks finish, it passes their results to the given handler function.

Constructor Summary

Constructors

Constructor and Description
JobWaiter(DAGScheduler dagScheduler, int jobId, int totalTasks, scala.Function2<Object,T,scala.runtime.BoxedUnit> resultHandler)

Method Summary

Methods

Modifier and Type	Method and Description
JobResult	awaitResult()
void	cancel() Sends a signal to the DAGScheduler to cancel the job.
void	jobFailed(Exception exception)
boolean	jobFinished()
int	jobId()
void	taskSucceeded(int index, Object result)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JobWaiter

public JobWaiter(DAGScheduler dagScheduler,
         int jobId,
         int totalTasks,
         scala.Function2<Object,T,scala.runtime.BoxedUnit> resultHandler)

Method Detail

jobId

public int jobId()

jobFinished

public boolean jobFinished()

cancel

public void cancel()

Sends a signal to the DAGScheduler to cancel the job. The cancellation itself is handled asynchronously. After the low level scheduler cancels all the tasks belonging to this job, it will fail this job with a SparkException.

taskSucceeded

public void taskSucceeded(int index,
                 Object result)

Specified by:

taskSucceeded in interface JobListener

jobFailed

public void jobFailed(Exception exception)

Specified by:

jobFailed in interface JobListener

awaitResult

public JobResult awaitResult()