Return a new DStream by applying incremental reduceByKey over a sliding window.
reduce the new values that entered the window (e.g., adding new counts)
“inverse reduce” the old values that left the window (e.g., subtracting old counts)
invFunc can be None, then it will reduce all the RDDs in window, could be slower
than having invFunc.
associative and commutative reduce function
inverse function of reduceFunc
width of the window; must be a multiple of this DStream’s
sliding interval of the window (i.e., the interval after which
the new DStream will generate RDDs); must be a multiple of this
DStream’s batching interval
number of partitions of each RDD in the new DStream.
function to filter expired key-value pairs;
only pairs that satisfy the function are retained
set this to null if you do not want to filter