Skip navigation links
Packages 
Package Description
org.apache.parquet.filter2.predicate  
org.apache.parquet.io  
org.apache.spark
Core Spark classes in Scala.
org.apache.spark.api.java
Spark Java programming APIs.
org.apache.spark.api.java.function
Set of interfaces to represent functions in Spark's Java API.
org.apache.spark.api.plugin  
org.apache.spark.api.r  
org.apache.spark.api.resource  
org.apache.spark.broadcast
Spark's broadcast variables, used to broadcast immutable datasets to all nodes.
org.apache.spark.errors  
org.apache.spark.graphx
ALPHA COMPONENT GraphX is a graph processing framework built on top of Spark.
org.apache.spark.graphx.impl  
org.apache.spark.graphx.lib
Various analytics functions for graphs.
org.apache.spark.graphx.util
Collections of utilities used by graphx.
org.apache.spark.input  
org.apache.spark.io
IO codecs used for compression.
org.apache.spark.kafka010  
org.apache.spark.launcher
Library for launching Spark applications programmatically.
org.apache.spark.mapred  
org.apache.spark.metrics  
org.apache.spark.metrics.sink  
org.apache.spark.metrics.source  
org.apache.spark.ml
DataFrame-based machine learning APIs to let users quickly assemble and configure practical machine learning pipelines.
org.apache.spark.ml.ann  
org.apache.spark.ml.attribute
ML attributes
org.apache.spark.ml.classification  
org.apache.spark.ml.clustering  
org.apache.spark.ml.evaluation  
org.apache.spark.ml.feature
Feature transformers The `ml.feature` package provides common feature transformers that help convert raw data or features into more suitable forms for model fitting.
org.apache.spark.ml.fpm  
org.apache.spark.ml.image  
org.apache.spark.ml.impl  
org.apache.spark.ml.linalg  
org.apache.spark.ml.optim  
org.apache.spark.ml.optim.aggregator  
org.apache.spark.ml.optim.loss  
org.apache.spark.ml.param  
org.apache.spark.ml.param.shared  
org.apache.spark.ml.r  
org.apache.spark.ml.recommendation  
org.apache.spark.ml.regression  
org.apache.spark.ml.source.image  
org.apache.spark.ml.source.libsvm  
org.apache.spark.ml.stat  
org.apache.spark.ml.stat.distribution  
org.apache.spark.ml.tree  
org.apache.spark.ml.tree.impl  
org.apache.spark.ml.tuning  
org.apache.spark.ml.util  
org.apache.spark.mllib
RDD-based machine learning APIs (in maintenance mode).
org.apache.spark.mllib.classification  
org.apache.spark.mllib.classification.impl  
org.apache.spark.mllib.clustering  
org.apache.spark.mllib.evaluation  
org.apache.spark.mllib.evaluation.binary  
org.apache.spark.mllib.feature  
org.apache.spark.mllib.fpm  
org.apache.spark.mllib.linalg  
org.apache.spark.mllib.linalg.distributed  
org.apache.spark.mllib.optimization  
org.apache.spark.mllib.pmml  
org.apache.spark.mllib.pmml.export  
org.apache.spark.mllib.random  
org.apache.spark.mllib.rdd  
org.apache.spark.mllib.recommendation  
org.apache.spark.mllib.regression  
org.apache.spark.mllib.regression.impl  
org.apache.spark.mllib.stat  
org.apache.spark.mllib.stat.correlation  
org.apache.spark.mllib.stat.distribution  
org.apache.spark.mllib.stat.test  
org.apache.spark.mllib.tree  
org.apache.spark.mllib.tree.configuration  
org.apache.spark.mllib.tree.impurity  
org.apache.spark.mllib.tree.loss  
org.apache.spark.mllib.tree.model  
org.apache.spark.mllib.util  
org.apache.spark.partial  
org.apache.spark.rdd
Provides implementation's of various RDDs.
org.apache.spark.resource  
org.apache.spark.scheduler
Spark's DAG scheduler.
org.apache.spark.scheduler.cluster  
org.apache.spark.scheduler.local  
org.apache.spark.security  
org.apache.spark.serializer
Pluggable serializers for RDD and shuffle data.
org.apache.spark.shuffle.api  
org.apache.spark.shuffle.api.metadata  
org.apache.spark.sql  
org.apache.spark.sql.api.java
Allows the execution of relational queries, including those expressed in SQL using Spark.
org.apache.spark.sql.api.r  
org.apache.spark.sql.avro  
org.apache.spark.sql.catalog  
org.apache.spark.sql.columnar  
org.apache.spark.sql.connector  
org.apache.spark.sql.connector.catalog  
org.apache.spark.sql.connector.catalog.functions  
org.apache.spark.sql.connector.catalog.index  
org.apache.spark.sql.connector.distributions  
org.apache.spark.sql.connector.expressions  
org.apache.spark.sql.connector.expressions.aggregate  
org.apache.spark.sql.connector.expressions.filter  
org.apache.spark.sql.connector.metric  
org.apache.spark.sql.connector.read  
org.apache.spark.sql.connector.read.partitioning  
org.apache.spark.sql.connector.read.streaming  
org.apache.spark.sql.connector.util  
org.apache.spark.sql.connector.write  
org.apache.spark.sql.connector.write.streaming  
org.apache.spark.sql.errors  
org.apache.spark.sql.expressions  
org.apache.spark.sql.expressions.javalang  
org.apache.spark.sql.expressions.scalalang  
org.apache.spark.sql.jdbc  
org.apache.spark.sql.sources  
org.apache.spark.sql.streaming  
org.apache.spark.sql.streaming.ui  
org.apache.spark.sql.types  
org.apache.spark.sql.util  
org.apache.spark.sql.vectorized  
org.apache.spark.status  
org.apache.spark.status.api.v1  
org.apache.spark.status.api.v1.sql  
org.apache.spark.status.api.v1.streaming  
org.apache.spark.storage  
org.apache.spark.storage.memory  
org.apache.spark.streaming  
org.apache.spark.streaming.api.java
Java APIs for spark streaming.
org.apache.spark.streaming.dstream
Various implementations of DStreams.
org.apache.spark.streaming.kinesis  
org.apache.spark.streaming.receiver  
org.apache.spark.streaming.scheduler  
org.apache.spark.streaming.scheduler.rate  
org.apache.spark.streaming.ui  
org.apache.spark.streaming.util  
org.apache.spark.ui  
org.apache.spark.ui.jobs  
org.apache.spark.ui.storage  
org.apache.spark.unsafe.types  
org.apache.spark.util
Spark utilities.
org.apache.spark.util.logging  
org.apache.spark.util.random
Utilities for random number generation.
org.apache.spark.util.sketch  
Skip navigation links