object SQLContext extends Serializable
This SQLContext object contains utility functions to create a singleton SQLContext instance, or to get the created SQLContext instance.
It also provides utility functions to support preference for threads in multiple sessions scenario, setActive could set a SQLContext for current thread, which will be returned by getOrCreate instead of the global one.
- Source
- SQLContext.scala
- Alphabetic
- By Inheritance
- SQLContext
- Serializable
- Serializable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Deprecated Value Members
-
def
clearActive(): Unit
Clears the active SQLContext for current thread.
Clears the active SQLContext for current thread. Subsequent calls to getOrCreate will return the first created context instead of a thread-local override.
- Annotations
- @deprecated
- Deprecated
(Since version 2.0.0) Use SparkSession.clearActiveSession instead
- Since
1.6.0
-
def
getOrCreate(sparkContext: SparkContext): SQLContext
Get the singleton SQLContext if it exists or create a new one using the given SparkContext.
Get the singleton SQLContext if it exists or create a new one using the given SparkContext.
This function can be used to create a singleton SQLContext object that can be shared across the JVM.
If there is an active SQLContext for current thread, it will be returned instead of the global one.
- Annotations
- @deprecated
- Deprecated
(Since version 2.0.0) Use SparkSession.builder instead
- Since
1.5.0
-
def
setActive(sqlContext: SQLContext): Unit
Changes the SQLContext that will be returned in this thread and its children when SQLContext.getOrCreate() is called.
Changes the SQLContext that will be returned in this thread and its children when SQLContext.getOrCreate() is called. This can be used to ensure that a given thread receives a SQLContext with an isolated session, instead of the global (first created) context.
- Annotations
- @deprecated
- Deprecated
(Since version 2.0.0) Use SparkSession.setActiveSession instead
- Since
1.6.0