Packages

object JavaStreamingContext

JavaStreamingContext object contains a number of utility functions.

Source
JavaStreamingContext.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JavaStreamingContext
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. def getOrCreate(checkpointPath: String, creatingFunc: Function0[JavaStreamingContext], hadoopConf: Configuration, createOnError: Boolean): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier StreamingContext program

    creatingFunc

    Function to create a new JavaStreamingContext

    hadoopConf

    Hadoop configuration if necessary for reading from any HDFS compatible file system

    createOnError

    Whether to create a new JavaStreamingContext if there is an error in reading checkpoint data.

  2. def getOrCreate(checkpointPath: String, creatingFunc: Function0[JavaStreamingContext], hadoopConf: Configuration): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier StreamingContext program

    creatingFunc

    Function to create a new JavaStreamingContext

    hadoopConf

    Hadoop configuration if necessary for reading from any HDFS compatible file system

  3. def getOrCreate(checkpointPath: String, creatingFunc: Function0[JavaStreamingContext]): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier JavaStreamingContext program

    creatingFunc

    Function to create a new JavaStreamingContext

  4. def jarOfClass(cls: Class[_]): Array[String]

    Find the JAR from which a given class was loaded, to make it easy for users to pass their JARs to StreamingContext.