AFTSurvivalRegression
regression
AFTSurvivalRegressionModel
regression
ALS
recommendation recommendation
ALSModel
recommendation
ANY
TaskLocality
AbsoluteError
loss
AbstractLauncher
launcher
Accumulable
spark
AccumulableInfo
scheduler v1
AccumulableParam
spark
Accumulator
spark
AccumulatorParam
spark
AccumulatorV2
util
Aggregator
spark expressions
Algo
configuration Algo
AnalysisException
sql
And
sources
AnyDataType
types
ApplicationAttemptInfo
v1
ApplicationEnvironmentInfo
v1
ApplicationInfo
v1
ApplicationStatus
v1
ApproxHist
QuantileStrategy
ArrayType
types
ArrowColumnVector
vectorized
Assignment
PowerIterationClustering
AssociationRules
fpm
AsyncRDDActions
rdd
AtomicType
types
Attribute
attribute
AttributeGroup
attribute
AttributeType
attribute
abort
DataSourceWriter DataWriter StreamWriter
abortJob
FileCommitProtocol HadoopMapReduceCommitProtocol
abortTask
FileCommitProtocol HadoopMapReduceCommitProtocol
abs
functions Decimal
acceptsType
ObjectType
accumUpdates
ExceptionFailure TaskKilled SparkListenerExecutorMetricsUpdate
accumulable
SparkContext JavaSparkContext
accumulableCollection
SparkContext
accumulables
StageInfo TaskInfo
accumulator
SparkContext JavaSparkContext
accumulatorUpdates
StageData TaskData
accuracy
LogisticRegressionSummary MulticlassMetrics MultilabelMetrics
acos
functions
active
SparkSession StreamingQueryManager ReceiverInfo
activeTasks
ExecutorSummary
add
Accumulable BlockMatrix MultivariateOnlineSummarizer StructType AccumulatorV2 CollectionAccumulator DoubleAccumulator LegacyAccumulatorWrapper LongAccumulator CountMinSketch
addAccumulator
AccumulableParam AccumulatorParam
addAppArgs
AbstractLauncher SparkLauncher
addBinary
CountMinSketch
addFile
SparkContext JavaSparkContext AbstractLauncher SparkLauncher
addGrid
ParamGridBuilder
addInPlace
AccumulableParam DoubleAccumulatorParam FloatAccumulatorParam IntAccumulatorParam LongAccumulatorParam
addIntercept
GeneralizedLinearAlgorithm
addJar
SparkContext JavaSparkContext AbstractLauncher SparkLauncher HiveSessionResourceLoader
addListener
SparkAppHandle StreamingQueryManager
addLong
CountMinSketch
addPyFile
AbstractLauncher SparkLauncher
addSparkArg
AbstractLauncher SparkLauncher
addSparkListener
SparkContext
addStreamingListener
StreamingContext JavaStreamingContext
addString
CountMinSketch
addTaskCompletionListener
BarrierTaskContext TaskContext
addTaskFailureListener
BarrierTaskContext TaskContext
addTime
ExecutorSummary
addURL
MutableURLClassLoader
add_months
functions
address
BarrierTaskInfo RDDDataDistribution
agg
Dataset KeyValueGroupedDataset RelationalGroupedDataset
aggUntyped
KeyValueGroupedDataset
aggregate
JavaRDDLike RDD
aggregateByKey
JavaPairRDD PairRDDFunctions
aggregateMessages
Graph
aggregateMessagesWithActiveSet
GraphImpl
aggregateUsingIndex
VertexRDD VertexRDDImpl
aggregationDepth
HasAggregationDepth
aggregator
ShuffleDependency
aic
GeneralizedLinearRegressionSummary
algo
Strategy DecisionTreeModel GradientBoostedTreesModel RandomForestModel
algorithm
StreamingLogisticRegressionWithSGD StreamingLinearAlgorithm StreamingLinearRegressionWithSGD
alias
Column Dataset
alpha
WeibullGenerator
analyzer
HiveSessionStateBuilder
and
Column
antecedent
Rule
anyNull
Row ColumnarRow
apache
org
api
spark sql status streaming
appAttemptId
SparkListenerApplicationStart
appId
SparkListenerApplicationStart
appName
SparkContext JavaSparkContext SparkListenerApplicationStart Builder
appSparkVersion
ApplicationAttemptInfo
appendBias
MLUtils
applicationAttemptId
SparkContext
applicationId
SparkContext
apply
Graph Pregel VertexRDD GraphImpl AttributeGroup DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector ParamMap DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector AccumulableInfo Column Dataset Row UserDefinedAggregateFunction UserDefinedFunction DetermineTableStats HiveAnalysis RelationConversions ResolveHiveSerdeTable HiveScriptIOSchema ProcessingTime ArrayType Decimal MapType StructType BlockId StorageLevel Milliseconds Minutes Seconds StatCounter
applySchema
SQLContext
approxCountDistinct
functions
approxQuantile
DataFrameStatFunctions
approx_count_distinct
functions
areaUnderPR
BinaryClassificationMetrics
areaUnderROC
BinaryLogisticRegressionSummary BinaryClassificationMetrics
argString
CreateHiveTableAsSelectCommand
argmax
DenseVector SparseVector Vector DenseVector SparseVector Vector
array
ColumnName functions ColumnarArray
arrayLengthGt
ParamValidators
array_contains
functions
array_distinct
functions
array_except
functions
array_intersect
functions
array_join
functions
array_max
functions
array_min
functions
array_position
functions
array_remove
functions
array_repeat
functions
array_sort
functions
array_union
functions
arrays_overlap
functions
arrays_zip
functions
as
Column Dataset
asBinary
LogisticRegressionSummary
asIterator
DeserializationStream
asKeyValueIterator
DeserializationStream
asML
DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector
asMap
DataSourceOptions
asNonNullable
UserDefinedFunction
asNondeterministic
UserDefinedFunction
asNullable
ObjectType
asRDDId
BlockId
asc
Column functions
asc_nulls_first
Column functions
asc_nulls_last
Column functions
ascii
functions
asin
functions
assertConf
HadoopWriteConfigUtil
assertValid
Broadcast
assignClusters
PowerIterationClustering
assignments
PowerIterationClusteringModel
associationRules
FPGrowthModel
atan
functions
atan2
functions
attempt
TaskData
attemptId
StageInfo ApplicationAttemptInfo StageData
attemptNumber
BarrierTaskContext TaskCommitDenied TaskContext StageInfo TaskInfo
attempts
ApplicationInfo
attr
Edge EdgeContext
attrType
Attribute BinaryAttribute NominalAttribute NumericAttribute UnresolvedAttribute
attribute
ml EqualNullSafe EqualTo GreaterThan GreaterThanOrEqual In IsNotNull IsNull LessThan LessThanOrEqual StringContains StringEndsWith StringStartsWith
attributes
AttributeGroup
available
NioBufferedFileInputStream ReadAheadInputStream
avg
RelationalGroupedDataset typed functions DoubleAccumulator LongAccumulator
avgEventRate
ReceiverInfo
avgInputRate
StreamingStatistics
avgMetrics
CrossValidatorModel
avgProcessingTime
StreamingStatistics
avgSchedulingDelay
StreamingStatistics
avgTotalDelay
StreamingStatistics
awaitAnyTermination
StreamingQueryManager
awaitTermination
StreamingQuery StreamingContext JavaStreamingContext
awaitTerminationOrTimeout
StreamingContext JavaStreamingContext