pyspark.streaming.DStream.checkpoint

DStream.checkpoint(interval: int) → pyspark.streaming.dstream.DStream[T][source]

Enable periodic checkpointing of RDDs of this DStream

Parameters
intervalint

time in seconds, after each period of that, generated RDD will be checkpointed

pyspark.streaming.DStream.cache pyspark.streaming.DStream.cogroup