| Interface | Description |
|---|---|
| CreateTableWriter<T> |
Trait to restrict calls to create and replace operations.
|
| Encoder<T> |
Used to convert a JVM object of type
T to and from the internal Spark SQL representation. |
| LowPrioritySQLImplicits |
Lower priority implicit methods for converting Scala objects into
Datasets. |
| RelationalGroupedDataset.GroupType |
The Grouping Type
|
| Row |
Represents one row of output from a relational operator.
|
| SparkSessionExtensionsProvider |
:: Unstable ::
|
| WriteConfigMethods<R> |
Configuration methods common to create/replace operations and insert/overwrite operations.
|
| Class | Description |
|---|---|
| Column |
A column that will be computed based on the data in a
DataFrame. |
| ColumnName |
A convenient class used for constructing schema.
|
| DataFrameNaFunctions |
Functionality for working with missing data in
DataFrames. |
| DataFrameReader |
Interface used to load a
Dataset from external storage systems (e.g. |
| DataFrameStatFunctions |
Statistic functions for
DataFrames. |
| DataFrameWriter<T> |
Interface used to write a
Dataset to external storage systems (e.g. |
| DataFrameWriterV2<T> |
Interface used to write a
Dataset to external storage using the v2 API. |
| Dataset<T> |
A Dataset is a strongly typed collection of domain-specific objects that can be transformed
in parallel using functional or relational operations.
|
| DatasetHolder<T> |
A container for a
Dataset, used for implicit conversions in Scala. |
| Encoders |
Methods for creating an
Encoder. |
| ExperimentalMethods |
:: Experimental ::
Holder for experimental methods for the bravest.
|
| ForeachWriter<T> |
The abstract class for writing custom logic to process data generated by a query.
|
| functions |
Commonly used functions available for DataFrame operations.
|
| KeyValueGroupedDataset<K,V> |
A
Dataset has been logically grouped by a user specified grouping key. |
| Observation |
Helper class to simplify usage of
Dataset.observe(String, Column, Column*): |
| RelationalGroupedDataset | |
| RelationalGroupedDataset.CubeType$ |
To indicate it's the CUBE
|
| RelationalGroupedDataset.GroupByType$ |
To indicate it's the GroupBy
|
| RelationalGroupedDataset.PivotType$ | |
| RelationalGroupedDataset.RollupType$ |
To indicate it's the ROLLUP
|
| RowFactory |
A factory class used to construct
Row objects. |
| RuntimeConfig |
Runtime configuration interface for Spark.
|
| SparkSession |
The entry point to programming Spark with the Dataset and DataFrame API.
|
| SparkSession.Builder |
Builder for
SparkSession. |
| SparkSessionExtensions |
:: Experimental ::
Holder for injection points to the
SparkSession. |
| SQLContext |
The entry point for working with structured data (rows and columns) in Spark 1.x.
|
| SQLImplicits |
A collection of implicit methods for converting common Scala objects into
Datasets. |
| TypedColumn<T,U> | |
| UDFRegistration |
Functions for registering user-defined functions.
|
| Enum | Description |
|---|---|
| SaveMode |
SaveMode is used to specify the expected behavior of saving a DataFrame to a data source.
|
| Exception | Description |
|---|---|
| AnalysisException |
Thrown when a query fails to analyze, usually because the query itself is invalid.
|