Package org.apache.spark.streaming.api.java

Class JavaMapWithStateDStream<KeyType,ValueType,StateType,MappedType>

Object

org.apache.spark.streaming.api.java.JavaDStream<MappedType>

org.apache.spark.streaming.api.java.JavaMapWithStateDStream<KeyType,ValueType,StateType,MappedType>

Type Parameters:

KeyType - Class of the keys

ValueType - Class of the values

StateType - Class of the state data

MappedType - Class of the mapped data

All Implemented Interfaces:

Serializable, JavaDStreamLike<MappedType,JavaDStream<MappedType>,JavaRDD<MappedType>>

public class JavaMapWithStateDStream<KeyType,ValueType,StateType,MappedType>
extends JavaDStream<MappedType>

DStream representing the stream of data generated by mapWithState operation on a JavaPairDStream. Additionally, it also gives access to the stream of state snapshots, that is, the state data of all keys after a batch has updated them.

See Also:

• Serialized Form

Method Summary

Modifier and Type	Method	Description
JavaPairDStream<KeyType,StateType>	stateSnapshots()

Methods inherited from class org.apache.spark.streaming.api.java.JavaDStream

cache, classTag, compute, dstream, filter, fromDStream, persist, persist, repartition, union, window, window, wrapRDD

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.streaming.api.java.JavaDStreamLike

checkpoint, context, count, countByValue, countByValue, countByValueAndWindow, countByValueAndWindow, countByWindow, flatMap, flatMapToPair, foreachRDD, foreachRDD, glom, map, mapPartitions, mapPartitionsToPair, mapToPair, print, print, reduce, reduceByWindow, reduceByWindow, scalaIntToJavaLong, slice, transform, transform, transformToPair, transformToPair, transformWith, transformWith, transformWithToPair, transformWithToPair

Method Details

stateSnapshots

public JavaPairDStream<KeyType,StateType> stateSnapshots()