org.apache.spark.streaming.api.java

JavaStreamingContext

object JavaStreamingContext

JavaStreamingContext object contains a number of utility functions.

Source
JavaStreamingContext.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. JavaStreamingContext
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  12. def getOrCreate(checkpointPath: String, creatingFunc: Function0[JavaStreamingContext], hadoopConf: Configuration, createOnError: Boolean): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier StreamingContext program

    creatingFunc

    Function to create a new JavaStreamingContext

    hadoopConf

    Hadoop configuration if necessary for reading from any HDFS compatible file system

    createOnError

    Whether to create a new JavaStreamingContext if there is an error in reading checkpoint data.

  13. def getOrCreate(checkpointPath: String, creatingFunc: Function0[JavaStreamingContext], hadoopConf: Configuration): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier StreamingContext program

    creatingFunc

    Function to create a new JavaStreamingContext

    hadoopConf

    Hadoop configuration if necessary for reading from any HDFS compatible file system

  14. def getOrCreate(checkpointPath: String, creatingFunc: Function0[JavaStreamingContext]): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier JavaStreamingContext program

    creatingFunc

    Function to create a new JavaStreamingContext

  15. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  16. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  17. def jarOfClass(cls: Class[_]): Array[String]

    Find the JAR from which a given class was loaded, to make it easy for users to pass their JARs to StreamingContext.

  18. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  19. final def notify(): Unit

    Definition Classes
    AnyRef
  20. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  22. def toString(): String

    Definition Classes
    AnyRef → Any
  23. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def getOrCreate(checkpointPath: String, hadoopConf: Configuration, factory: JavaStreamingContextFactory, createOnError: Boolean): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier StreamingContext program

    hadoopConf

    Hadoop configuration if necessary for reading from any HDFS compatible file system

    factory

    JavaStreamingContextFactory object to create a new JavaStreamingContext

    createOnError

    Whether to create a new JavaStreamingContext if there is an error in reading checkpoint data.

    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) use getOrCreate without JavaStreamingContextFactory

  2. def getOrCreate(checkpointPath: String, hadoopConf: Configuration, factory: JavaStreamingContextFactory): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier StreamingContext program

    hadoopConf

    Hadoop configuration if necessary for reading from any HDFS compatible file system

    factory

    JavaStreamingContextFactory object to create a new JavaStreamingContext

    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) use getOrCreate without JavaStreamingContextFactory

  3. def getOrCreate(checkpointPath: String, factory: JavaStreamingContextFactory): JavaStreamingContext

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext.

    Either recreate a StreamingContext from checkpoint data or create a new StreamingContext. If checkpoint data exists in the provided checkpointPath, then StreamingContext will be recreated from the checkpoint data. If the data does not exist, then the provided factory will be used to create a JavaStreamingContext.

    checkpointPath

    Checkpoint directory used in an earlier JavaStreamingContext program

    factory

    JavaStreamingContextFactory object to create a new JavaStreamingContext

    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) use getOrCreate without JavaStreamingContextFactor

Inherited from AnyRef

Inherited from Any

Ungrouped