org.apache.spark.rdd

Class RDDCheckpointData<T>

Object

org.apache.spark.rdd.RDDCheckpointData<T>

All Implemented Interfaces:

java.io.Serializable, Logging

public class RDDCheckpointData<T>
extends Object
implements Logging, scala.Serializable

This class contains all the information related to RDD checkpointing. Each instance of this class is associated with a RDD. It manages process of checkpointing of the associated RDD, as well as, manages the post-checkpoint state by providing the updated partitions, iterator and preferred locations of the checkpointed RDD.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
RDDCheckpointData(RDD<T> rdd, scala.reflect.ClassTag<T> evidence$1)

Method Summary

Methods

Modifier and Type	Method and Description
scala.Option<RDD<T>>	checkpointRDD()
scala.Option<String>	cpFile()
scala.Option<RDD<T>>	cpRDD()
scala.Enumeration.Value	cpState()
void	doCheckpoint()
scala.Option<String>	getCheckpointFile()
Partition[]	getPartitions()
scala.collection.Seq<String>	getPreferredLocations(Partition split)
boolean	isCheckpointed()
void	markForCheckpoint()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

RDDCheckpointData

public RDDCheckpointData(RDD<T> rdd,
                 scala.reflect.ClassTag<T> evidence$1)

Method Detail

cpState

public scala.Enumeration.Value cpState()

cpFile

public scala.Option<String> cpFile()

cpRDD

public scala.Option<RDD<T>> cpRDD()

markForCheckpoint

public void markForCheckpoint()

isCheckpointed

public boolean isCheckpointed()

getCheckpointFile

public scala.Option<String> getCheckpointFile()

doCheckpoint

public void doCheckpoint()

getPreferredLocations

public scala.collection.Seq<String> getPreferredLocations(Partition split)

getPartitions

public Partition[] getPartitions()

checkpointRDD

public scala.Option<RDD<T>> checkpointRDD()