Interface | Description |
---|---|
ActorLogReceive |
A trait to enable logging all Akka actor messages.
|
Clock |
An interface to represent clocks, so that they can be mocked out in unit tests.
|
TaskCompletionListener |
:: DeveloperApi ::
|
Class | Description |
---|---|
AkkaUtils |
Various utility classes for working with Akka.
|
BoundedPriorityQueue<A> |
Bounded priority queue.
|
ByteBufferInputStream |
Reads data from a ByteBuffer, and optionally cleans it up using BlockManager.dispose()
at the end of the stream (e.g.
|
CallSite |
CallSite represents a place in user code.
|
ClosureCleaner | |
CollectionsUtils | |
CompletionIterator<A,I extends scala.collection.Iterator<A>> |
Wrapper around an iterator which calls a completion method after it successfully iterates
through all the elements.
|
Distribution |
Util for getting some stats from a small sample of numeric values, with some handy
summary functions.
|
FieldAccessFinder | |
FileLogger |
A generic class for logging information to file.
|
IdGenerator |
A util used to get a unique generation ID.
|
InnerClosureFinder | |
IntParam |
An extractor object for parsing strings into integers.
|
JsonProtocol |
Serializes SparkListener events to/from JSON.
|
MemoryParam |
An extractor object for parsing JVM memory strings, such as "10g", into an Int representing
the number of megabytes.
|
MetadataCleaner |
Runs a timer task to periodically clean up metadata (e.g.
|
MetadataCleanerType | |
MutablePair<T1,T2> |
:: DeveloperApi ::
A tuple of 2 elements.
|
NextIterator<U> |
Provides a basic/boilerplate Iterator implementation.
|
ParentClassLoader |
A class loader which makes findClass accesible to the child
|
RedirectThread |
A utility class to redirect the child process's stdout or stderr.
|
ReturnStatementFinder | |
SerializableBuffer |
A wrapper around a java.nio.ByteBuffer that is serializable through Java serialization, to make
it easier to pass ByteBuffers in case class messages.
|
SignalLogger |
Used to log signals received.
|
SignalLoggerHandler | |
SizeEstimator |
Estimates the sizes of Java objects (number of bytes of memory they occupy), for use in
memory-aware caches.
|
SparkExitCode | |
SparkUncaughtExceptionHandler |
The default uncaught exception handler for Executors terminates the whole process, to avoid
getting into a bad state indefinitely.
|
StatCounter |
A class for tracking the statistics of a set of numbers (count, mean and variance) in a
numerically robust way.
|
SystemClock | |
ThreadStackTrace |
Used for shipping per-thread stacktraces from the executors to driver.
|
TimeStampedHashMap<A,B> |
This is a custom implementation of scala.collection.mutable.Map which stores the insertion
timestamp along with each key-value pair.
|
TimeStampedHashSet<A> | |
TimeStampedValue<V> | |
TimeStampedWeakValueHashMap<A,B> |
A wrapper of TimeStampedHashMap that ensures the values are weakly referenced and timestamped.
|
Utils |
Various utility methods used by Spark.
|
Vector | |
Vector.Multiplier | |
Vector.VectorAccumParam$ |
Exception | Description |
---|---|
TaskCompletionListenerException |
Exception thrown when there is an exception in
executing the callback in TaskCompletionListener.
|