Package org.apache.spark.util
package org.apache.spark.util
Spark utilities.
-
ClassDescriptionAccumulatorV2<IN,
OUT> The base class for accumulators, that can accumulate inputs of typeIN, and produce output of typeOUT.A lock-free implementation of a lazily-initialized variable.A mutable class loader that gives preference to its own URLs over the parent class loader when loading classes and resources.Anaccumulatorfor collecting a list of elements.Anaccumulatorfor computing sum, count, and averages for double precision floating numbers.Subclass of ByteArrayOutputStream that exposes `buf` directly.LastAttemptAccumulator<IN,OUT, PARTIAL> A trait that can be mixed into a subclass ofAccumulatorV2to track the "logical" value of the "last attempt" of the execution using the accumulator - aggregated from the last attempts of any Task that calculated some RDD partitions and used this accumulator, and discarding any values coming from earlier attempts that have been recomputed.Helper trait for defining thread locals with lexical scoping.Final class representing a handle to a thread local value.:: : DeveloperApi :: Utils for querying Spark logs with Spark SQL.Anaccumulatorfor computing sum, count, and average of 64-bit integers.MutablePair<T1,T2> :: DeveloperApi :: A tuple of 2 elements.URL class loader that exposes the `addURL` method in URLClassLoader.Pair<L,R> An immutable pair of values.A class loader which makes some protected methods in ClassLoader accessible.Hadoop configuration but serializable.:: DeveloperApi :: Estimates the sizes of Java objects (number of bytes of memory they occupy), for use in memory-aware caches.A class for tracking the statistics of a set of numbers (count, mean and variance) in a numerically robust way.:: DeveloperApi :::: DeveloperApi :::: DeveloperApi ::A lock-free implementation of a lazily-initialized variable.Generator for UUIDv7 as defined in RFC 9562.