Packages

c

org.apache.spark.sql

RuntimeConfig

class RuntimeConfig extends AnyRef

Runtime configuration interface for Spark. To access this, use SparkSession.conf.

Options set here are automatically propagated to the Hadoop configuration during I/O.

Annotations
@Stable()
Source
RuntimeConfig.scala
Since

2.0.0

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RuntimeConfig
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Value Members

  1. def get(key: String, default: String): String

    Returns the value of Spark runtime configuration property for the given key.

    Returns the value of Spark runtime configuration property for the given key.

    Since

    2.0.0

  2. def get(key: String): String

    Returns the value of Spark runtime configuration property for the given key.

    Returns the value of Spark runtime configuration property for the given key.

    Annotations
    @throws("if the key is not set")
    Since

    2.0.0

    Exceptions thrown

    java.util.NoSuchElementException if the key is not set and does not have a default value

  3. def getAll: Map[String, String]

    Returns all properties set in this conf.

    Returns all properties set in this conf.

    Since

    2.0.0

  4. def getOption(key: String): Option[String]

    Returns the value of Spark runtime configuration property for the given key.

    Returns the value of Spark runtime configuration property for the given key.

    Since

    2.0.0

  5. def isModifiable(key: String): Boolean

    Indicates whether the configuration property with the given key is modifiable in the current session.

    Indicates whether the configuration property with the given key is modifiable in the current session.

    returns

    true if the configuration property is modifiable. For static SQL, Spark Core, invalid (not existing) and other non-modifiable configuration properties, the returned value is false.

    Since

    2.4.0

  6. def set(key: String, value: Long): Unit

    Sets the given Spark runtime configuration property.

    Sets the given Spark runtime configuration property.

    Since

    2.0.0

  7. def set(key: String, value: Boolean): Unit

    Sets the given Spark runtime configuration property.

    Sets the given Spark runtime configuration property.

    Since

    2.0.0

  8. def set(key: String, value: String): Unit

    Sets the given Spark runtime configuration property.

    Sets the given Spark runtime configuration property.

    Since

    2.0.0

  9. val sqlConf: SQLConf
  10. def unset(key: String): Unit

    Resets the configuration property for the given key.

    Resets the configuration property for the given key.

    Since

    2.0.0