Package org.apache.spark.rdd

Class DeterministicLevel

Object
org.apache.spark.rdd.DeterministicLevel
public class DeterministicLevel extends Object
The deterministic level of RDD's output (i.e. what RDD#compute returns). This explains how the output will diff when Spark reruns the tasks for the RDD. There are 3 deterministic levels: 1. DETERMINATE: The RDD output is always the same data set in the same order after a rerun. 2. UNORDERED: The RDD output is always the same data set but the order can be different after a rerun. 3. INDETERMINATE. The RDD output can be different after a rerun.

Note that, the output of an RDD usually relies on the parent RDDs. When the parent RDD's output is INDETERMINATE, it's very likely the RDD's output is also INDETERMINATE.

  • Constructor Details

    • DeterministicLevel

      public DeterministicLevel()

  • Method Details

    • DETERMINATE

      public static scala.Enumeration.Value DETERMINATE()

    • UNORDERED

      public static scala.Enumeration.Value UNORDERED()

    • INDETERMINATE

      public static scala.Enumeration.Value INDETERMINATE()

    • toString

      public static String toString()

    • values

      public static scala.Enumeration.ValueSet values()

    • maxId

      public static final int maxId()

    • apply

      public static final scala.Enumeration.Value apply(int x)

    • withName

      public static final scala.Enumeration.Value withName(String s)