Package

org.apache.spark.sql

hive

Permalink

package hive

Support for running Spark SQL queries using functionality from Apache Hive (does not require an existing Hive installation). Supported Hive features include:

Users that would like access to this functionality should create a HiveContext instead of a SQLContext.

Source
package.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. hive
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class DetermineTableStats extends Rule[LogicalPlan]

    Permalink
  2. class HiveSessionResourceLoader extends SessionResourceLoader

    Permalink
  3. class HiveSessionStateBuilder extends BaseSessionStateBuilder

    Permalink

    Builder that produces a Hive-aware SessionState.

    Builder that produces a Hive-aware SessionState.

    Annotations
    @Experimental() @Unstable()
  4. case class RelationConversions(conf: SQLConf, sessionCatalog: HiveSessionCatalog) extends Rule[LogicalPlan] with Product with Serializable

    Permalink

    Relation conversion from metastore relations to data source relations for better performance

    Relation conversion from metastore relations to data source relations for better performance

    - When writing to non-partitioned Hive-serde Parquet/Orc tables - When scanning Hive-serde Parquet/ORC tables

    This rule must be run before all other DDL post-hoc resolution rules, i.e. PreprocessTableCreation, PreprocessTableInsertion, DataSourceAnalysis and HiveAnalysis.

  5. class ResolveHiveSerdeTable extends Rule[LogicalPlan]

    Permalink

    Determine the database, serde/format and schema of the Hive serde table, according to the storage properties.

  6. class HiveContext extends SQLContext with Logging

    Permalink

    An instance of the Spark SQL execution engine that integrates with data stored in Hive.

    An instance of the Spark SQL execution engine that integrates with data stored in Hive. Configuration for Hive is read from hive-site.xml on the classpath.

    Annotations
    @deprecated
    Deprecated

    (Since version 2.0.0) Use SparkSession.builder.enableHiveSupport instead

Value Members

  1. object HiveAnalysis extends Rule[LogicalPlan]

    Permalink

    Replaces generic operations with specific variants that are designed to work with Hive.

    Replaces generic operations with specific variants that are designed to work with Hive.

    Note that, this rule must be run after PreprocessTableCreation and PreprocessTableInsertion.

  2. object HiveExternalCatalog

    Permalink
  3. package execution

    Permalink
  4. package orc

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped