Packages

t

org.apache.spark

JobSubmitter

trait JobSubmitter extends AnyRef

Developer API

Handle via which a "run" function passed to a ComplexFutureAction can submit jobs for execution.

Annotations
@DeveloperApi()
Source
FutureAction.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JobSubmitter
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def submitJob[T, U, R](rdd: RDD[T], processPartition: (Iterator[T]) ⇒ U, partitions: Seq[Int], resultHandler: (Int, U) ⇒ Unit, resultFunc: ⇒ R): FutureAction[R]

    Submit a job for execution and return a FutureAction holding the result.

    Submit a job for execution and return a FutureAction holding the result. This is a wrapper around the same functionality provided by SparkContext to enable cancellation.