Package org.apache.spark

Interface JobSubmitter

public interface JobSubmitter
Handle via which a "run" function passed to a ComplexFutureAction can submit jobs for execution.

  • Method Summary

    Modifier and Type
    Method
    Description
    <T, U, R> FutureAction<R>
    submitJob(RDD<T> rdd, scala.Function1<scala.collection.Iterator<T>,U> processPartition, scala.collection.Seq<Object> partitions, scala.Function2<Object,U,scala.runtime.BoxedUnit> resultHandler, scala.Function0<R> resultFunc)
    Submit a job for execution and return a FutureAction holding the result.

  • Method Details

    • submitJob

      <T, U, R> FutureAction<R> submitJob(RDD<T> rdd, scala.Function1<scala.collection.Iterator<T>,U> processPartition, scala.collection.Seq<Object> partitions, scala.Function2<Object,U,scala.runtime.BoxedUnit> resultHandler, scala.Function0<R> resultFunc)
      Submit a job for execution and return a FutureAction holding the result. This is a wrapper around the same functionality provided by SparkContext to enable cancellation.
      Parameters:
      rdd - (undocumented)
      processPartition - (undocumented)
      partitions - (undocumented)
      resultHandler - (undocumented)
      resultFunc - (undocumented)
      Returns:
      (undocumented)