Trait/Object

org.apache.spark

AccumulatorParam

Related Docs: object AccumulatorParam | package spark

Permalink

trait AccumulatorParam[T] extends AccumulableParam[T, T]

A simpler version of org.apache.spark.AccumulableParam where the only data type you can add in is the same type as the accumulated value. An implicit AccumulatorParam object needs to be available when you create Accumulators of a specific type.

T

type of value to accumulate

Annotations
@deprecated
Deprecated

(Since version 2.0.0) use AccumulatorV2

Source
Accumulator.scala
Linear Supertypes
AccumulableParam[T, T], Serializable, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. AccumulatorParam
  2. AccumulableParam
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def addInPlace(r1: T, r2: T): T

    Permalink

    Merge two accumulated values together.

    Merge two accumulated values together. Is allowed to modify and return the first value for efficiency (to avoid allocating objects).

    r1

    one set of accumulated data

    r2

    another set of accumulated data

    returns

    both data sets merged together

    Definition Classes
    AccumulableParam
  2. abstract def zero(initialValue: T): T

    Permalink

    Return the "zero" (identity) value for an accumulator type, given its initial value.

    Return the "zero" (identity) value for an accumulator type, given its initial value. For example, if R was a vector of N dimensions, this would return a vector of N zeroes.

    Definition Classes
    AccumulableParam

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def addAccumulator(t1: T, t2: T): T

    Permalink

    Add additional data to the accumulator value.

    Add additional data to the accumulator value. Is allowed to modify and return r for efficiency (to avoid allocating objects).

    returns

    the new value of the accumulator

    Definition Classes
    AccumulatorParamAccumulableParam
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  11. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  12. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  13. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  15. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  16. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  17. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  18. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AccumulableParam[T, T]

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped