Packages

object SQLContext extends Serializable

This SQLContext object contains utility functions to create a singleton SQLContext instance, or to get the created SQLContext instance.

It also provides utility functions to support preference for threads in multiple sessions scenario, setActive could set a SQLContext for current thread, which will be returned by getOrCreate instead of the global one.

Source
SQLContext.scala
Linear Supertypes
Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SQLContext
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Deprecated Value Members

  1. def clearActive(): Unit

    Clears the active SQLContext for current thread.

    Clears the active SQLContext for current thread. Subsequent calls to getOrCreate will return the first created context instead of a thread-local override.

    Annotations
    @deprecated
    Deprecated

    (Since version 2.0.0) Use SparkSession.clearActiveSession instead

    Since

    1.6.0

  2. def getOrCreate(sparkContext: SparkContext): SQLContext

    Get the singleton SQLContext if it exists or create a new one using the given SparkContext.

    Get the singleton SQLContext if it exists or create a new one using the given SparkContext.

    This function can be used to create a singleton SQLContext object that can be shared across the JVM.

    If there is an active SQLContext for current thread, it will be returned instead of the global one.

    Annotations
    @deprecated
    Deprecated

    (Since version 2.0.0) Use SparkSession.builder instead

    Since

    1.5.0

  3. def setActive(sqlContext: SQLContext): Unit

    Changes the SQLContext that will be returned in this thread and its children when SQLContext.getOrCreate() is called.

    Changes the SQLContext that will be returned in this thread and its children when SQLContext.getOrCreate() is called. This can be used to ensure that a given thread receives a SQLContext with an isolated session, instead of the global (first created) context.

    Annotations
    @deprecated
    Deprecated

    (Since version 2.0.0) Use SparkSession.setActiveSession instead

    Since

    1.6.0