class MapperRowCounter extends AccumulatorV2[Long, List[(Integer, Long)]]
An AccumulatorV2 counter for collecting a list of (mapper index, row count).
- Source
- MapperRowCounter.scala
- Since
3.4.0
- Alphabetic
- By Inheritance
- MapperRowCounter
- AccumulatorV2
- Serializable
- Serializable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new MapperRowCounter()
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
add(v: Long): Unit
Takes the inputs and accumulates.
Takes the inputs and accumulates.
- Definition Classes
- MapperRowCounter → AccumulatorV2
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
copy(): MapperRowCounter
Creates a new copy of this accumulator.
Creates a new copy of this accumulator.
- Definition Classes
- MapperRowCounter → AccumulatorV2
-
def
copyAndReset(): MapperRowCounter
Creates a new copy of this accumulator, which is zero value.
Creates a new copy of this accumulator, which is zero value. i.e. call
isZero
on the copy must return true.- Definition Classes
- MapperRowCounter → AccumulatorV2
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
id: Long
Returns the id of this accumulator, can only be called after registration.
Returns the id of this accumulator, can only be called after registration.
- Definition Classes
- AccumulatorV2
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
isRegistered: Boolean
Returns true if this accumulator has been registered.
Returns true if this accumulator has been registered.
- Definition Classes
- AccumulatorV2
- Note
All accumulators must be registered before use, or it will throw exception.
-
def
isZero: Boolean
Returns false if this accumulator has had any values added to it or the sum is non-zero.
Returns false if this accumulator has had any values added to it or the sum is non-zero.
- Definition Classes
- MapperRowCounter → AccumulatorV2
-
def
merge(other: AccumulatorV2[Long, List[(Integer, Long)]]): Unit
Merges another same-type accumulator into this one and update its state, i.e.
Merges another same-type accumulator into this one and update its state, i.e. this should be merge-in-place.
- Definition Classes
- MapperRowCounter → AccumulatorV2
-
final
def
name: Option[String]
Returns the name of this accumulator, can only be called after registration.
Returns the name of this accumulator, can only be called after registration.
- Definition Classes
- AccumulatorV2
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
reset(): Unit
Resets this accumulator, which is zero value.
Resets this accumulator, which is zero value. i.e. call
isZero
must return true.- Definition Classes
- MapperRowCounter → AccumulatorV2
- def setPartitionId(id: Integer): Unit
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AccumulatorV2 → AnyRef → Any
-
def
value: List[(Integer, Long)]
Defines the current value of this accumulator
Defines the current value of this accumulator
- Definition Classes
- MapperRowCounter → AccumulatorV2
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
withBufferSerialized(): AccumulatorV2[Long, List[(Integer, Long)]]
- Attributes
- protected
- Definition Classes
- AccumulatorV2
-
final
def
writeReplace(): Any
- Attributes
- protected
- Definition Classes
- AccumulatorV2