Package org.apache.spark.streaming
Class CheckpointReader
Object
org.apache.spark.streaming.CheckpointReader
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionstatic org.apache.spark.internal.Logging.LogStringContext
LogStringContext
(scala.StringContext sc) static org.slf4j.Logger
static void
org$apache$spark$internal$Logging$$log__$eq
(org.slf4j.Logger x$1) static scala.Option<org.apache.spark.streaming.Checkpoint>
Read checkpoint files present in the given checkpoint directory.static scala.Option<org.apache.spark.streaming.Checkpoint>
read
(String checkpointDir, SparkConf conf, org.apache.hadoop.conf.Configuration hadoopConf, boolean ignoreReadError) Read checkpoint files present in the given checkpoint directory.
-
Constructor Details
-
CheckpointReader
public CheckpointReader()
-
-
Method Details
-
read
Read checkpoint files present in the given checkpoint directory. If there are no checkpoint files, then return None, else try to return the latest valid checkpoint object. If no checkpoint files could be read correctly, then return None.- Parameters:
checkpointDir
- (undocumented)- Returns:
- (undocumented)
-
read
public static scala.Option<org.apache.spark.streaming.Checkpoint> read(String checkpointDir, SparkConf conf, org.apache.hadoop.conf.Configuration hadoopConf, boolean ignoreReadError) Read checkpoint files present in the given checkpoint directory. If there are no checkpoint files, then return None, else try to return the latest valid checkpoint object. If no checkpoint files could be read correctly, then return None (if ignoreReadError = true), or throw exception (if ignoreReadError = false).- Parameters:
checkpointDir
- (undocumented)conf
- (undocumented)hadoopConf
- (undocumented)ignoreReadError
- (undocumented)- Returns:
- (undocumented)
-
org$apache$spark$internal$Logging$$log_
public static org.slf4j.Logger org$apache$spark$internal$Logging$$log_() -
org$apache$spark$internal$Logging$$log__$eq
public static void org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1) -
LogStringContext
public static org.apache.spark.internal.Logging.LogStringContext LogStringContext(scala.StringContext sc)
-