Package org.apache.spark.streaming.dstream
package org.apache.spark.streaming.dstream
Various implementations of DStreams.
-
ClassesClassDescriptionAn input stream that always returns the same RDD on each time step.DStream<T>A Discretized Stream (DStream), the basic abstraction in Spark Streaming, is a continuous sequence of RDDs (of the same type) representing a continuous stream of data (see org.apache.spark.rdd.RDD in the Spark core documentation for more details on RDDs).InputDStream<T>This is the abstract base class for all input streams.MapWithStateDStream<KeyType,
ValueType, StateType, MappedType> DStream representing the stream of data generated bymapWithStateoperation on apair DStream.PairDStreamFunctions<K,V> Extra functions available on DStream of (key, value) pairs through an implicit conversion.Abstract class for defining anyInputDStreamthat has to start a receiver on worker nodes to receive external data.