Helper object defining how to accumulate values of a particular type.
A simpler version of
Classes that represent cleaning tasks.
A future for the result of an action to support cancellation.
Utility trait for classes that want to log data.
An identifier for a partition in an RDD.
Exposes information about Spark Jobs.
Exposes information about Spark Stages.
:: DeveloperApi :: Various possible reasons why a task ended.
:: DeveloperApi :: Various possible reasons why a task failed.
A data type that can be accumulated, ie has an commutative and associative "add" operation, but where the result type,
A simpler value of
:: DeveloperApi :: A set of functions used to aggregate data.
A WeakReference associated with a CleanupTask.
:: DeveloperApi :: Base class for dependencies.
:: DeveloperApi :: Task failed due to a runtime exception.
:: DeveloperApi :: The task failed because the executor that it was running on was lost.
:: DeveloperApi :: Task failed to fetch shuffle data from a remote node.
:: DeveloperApi :: An iterator that wraps around an existing iterator to provide task killing functionality.
Java clients should extend this class instead of implementing SparkListener directly.
:: DeveloperApi :: Base class for dependencies where each partition of the child RDD depends on a small number of partitions of the parent RDD.
:: DeveloperApi :: Represents a one-to-one dependency between partitions of the parent and child RDDs.
An object that defines how the elements in a key-value pair RDD are partitioned by key.
:: DeveloperApi :: Represents a one-to-one dependency between ranges of partitions in the parent and child RDDs.
:: DeveloperApi :: A
|SerializableWritable<T extends org.apache.hadoop.io.Writable>|
:: DeveloperApi :: Represents a dependency on the output of a shuffle stage.
Configuration for a Spark application.
Main entry point for Spark functionality.
:: DeveloperApi :: Holds all the runtime environment objects for a running Spark instance (either master or worker), including the serializer, Akka actor system, block manager, map output tracker, etc.
Resolves paths to files added through
Class that allows users to receive all SparkListener events.
A collection of regexes for extracting information from the master string.
Low-level status reporting APIs for monitoring job and stage progress.
:: DeveloperApi :: Task succeeded.
:: DeveloperApi :: Task requested the driver to commit, but was denied.
Contextual information about a task which can be read or mutated during execution.
:: DeveloperApi :: Task was killed intentionally and needs to be rescheduled.
:: DeveloperApi :: The task finished successfully, but the result was lost from the executor's block manager before it was fetched.
:: DeveloperApi :: We don't know why the task ended -- for example, because of a ClassNotFound exception when deserializing the task result.
:: DeveloperApi :: Exception thrown when a task is explicitly killed (i.e., task failure is expected).