CalendarIntervalType
types
CanonicalRandomVertexCut
PartitionStrategy
CatalystScan
sources
Categorical
FeatureType
CategoricalSplit
tree
ChiSqSelector
feature
ChiSqSelectorModel
feature
ChiSqTestResult
test
Classification
Algo
ClassificationModel
classification classification
Classifier
classification
CoGroupedRDD
rdd
Column
sql
ColumnName
sql
Combiner
bagel
ComplexFutureAction
spark
CompressionCodec
io
Conf
SVDPlusPlus
ConnectedComponents
lib
ConnectionFactory
JdbcRDD
ConstantInputDStream
dstream
Continuous
FeatureType
ContinuousSplit
tree
CoordinateMatrix
distributed
CountVectorizer
feature
CountVectorizerModel
feature
CreatableRelationProvider
sources
CrossValidator
tuning
CrossValidatorModel
tuning
cache
JavaDoubleRDD JavaPairRDD JavaRDD Graph EdgeRDDImpl GraphImpl VertexRDDImpl BlockMatrix RDD DataFrame JavaDStream JavaPairDStream DStream
cacheManager
SparkEnv SQLContext
cacheTable
SQLContext
cachedLeafStatuses
HadoopFsRelation
calculate
Entropy Gini Impurity Variance
call
DoubleFlatMapFunction DoubleFunction FlatMapFunction FlatMapFunction2 Function Function0 Function2 Function3 PairFlatMapFunction PairFunction VoidFunction UDF1 UDF10 UDF11 UDF12 UDF13 UDF14 UDF15 UDF16 UDF17 UDF18 UDF19 UDF2 UDF20 UDF21 UDF22 UDF3 UDF4 UDF5 UDF6 UDF7 UDF8 UDF9
callUDF
functions
callUdf
functions
canEqual
ExecutorInfo MutablePair
canHandle
AggregatedDialect JdbcDialect MySQLDialect NoopDialect PostgresDialect
cancel
ComplexFutureAction FutureAction SimpleFutureAction
cancelAllJobs
SparkContext JavaSparkContext
cancelJobGroup
SparkContext JavaSparkContext
cartesian
JavaRDDLike RDD
caseSensitive
StopWordsRemover
cast
Column
catalog
SQLContext HiveContext
categoricalFeaturesInfo
Strategy
categories
Split
categoryMaps
VectorIndexerModel
cbrt
functions
ceil
functions
changePrecision
Decimal
checkpoint
JavaRDDLike Graph EdgeRDDImpl GraphImpl VertexRDDImpl HadoopRDD RDD StreamingContext JavaDStreamLike JavaStreamingContext DStream
checkpointFile
SparkContext JavaSparkContext
checkpointInterval
Strategy
chiSqTest
Statistics
child
Not
className
ExceptionFailure
classTag
JavaDoubleRDD JavaPairRDD JavaRDD JavaRDDLike JavaDStream JavaDStreamLike JavaInputDStream JavaPairDStream JavaReceiverInputDStream
classification
ml mllib
classpathEntries
EnvironmentListener
clean
WriteAheadLog
clear
Params
clearCache
SQLContext
clearCallSite
SparkContext JavaSparkContext
clearDependencies
CoGroupedRDD RDD ShuffledRDD UnionRDD
clearFiles
SparkContext JavaSparkContext
clearJars
SparkContext JavaSparkContext
clearJobGroup
SparkContext JavaSparkContext
clearThreshold
LogisticRegressionModel SVMModel
clone
SparkConf Decimal StorageLevel BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler
cloneComplement
BernoulliCellSampler
close
JavaSparkContext PortableDataStream DeserializationStream SerializationStream OutputWriter TimeTrackingOutputStream JavaStreamingContext WriteAheadLog
closeLogWriter
JobLogger
closureSerializer
SparkEnv
cluster
Assignment scheduler
clusterCenters
KMeansModel KMeansModel StreamingKMeansModel
clusterWeights
StreamingKMeansModel
clustering
ml mllib
coalesce
JavaDoubleRDD JavaPairRDD JavaRDD RDD DataFrame functions
codegenEnabled
SparkPlanner
cogroup
JavaPairRDD PairRDDFunctions JavaPairDStream PairDStreamFunctions
col
DataFrame functions
colPtrs
SparseMatrix
colStats
Statistics
collect
JavaRDDLike EdgeRDDImpl RDD DataFrame
collectAsList
DataFrame
collectAsMap
JavaPairRDD PairRDDFunctions
collectAsync
JavaRDDLike AsyncRDDActions
collectEdges
GraphOps
collectNeighborIds
GraphOps
collectNeighbors
GraphOps
collectPartitions
JavaRDDLike
colsPerBlock
BlockMatrix
column
functions
columnSimilarities
RowMatrix
columns
DataFrame
combineByKey
JavaPairRDD PairRDDFunctions JavaPairDStream PairDStreamFunctions
combineCombinersByKey
Aggregator
combineValuesByKey
Aggregator
commitTask
SparkHadoopMapRedUtil
compare
Decimal RDDInfo
completed
ApplicationAttemptInfo
completedJobs
JobProgressListener
completedStages
JobProgressListener
completedTasks
ExecutorSummary
completionTime
StageInfo JobData
compressed
Vector
compressedInputStream
CompressionCodec LZ4CompressionCodec LZFCompressionCodec SnappyCompressionCodec
compressedOutputStream
CompressionCodec LZ4CompressionCodec LZFCompressionCodec SnappyCompressionCodec
compute
EdgeRDD VertexRDD Gradient HingeGradient L1Updater LeastSquaresGradient LogisticGradient SimpleUpdater SquaredL2Updater Updater CoGroupedRDD HadoopRDD JdbcRDD NewHadoopRDD PartitionPruningRDD RDD ShuffledRDD UnionRDD JavaDStream JavaPairDStream ConstantInputDStream DStream ReceiverInputDStream
computeColumnSummaryStatistics
RowMatrix
computeCost
KMeansModel
computeCovariance
RowMatrix
computeError
Loss
computeGramianMatrix
IndexedRowMatrix RowMatrix
computeInitialPredictionAndError
GradientBoostedTreesModel
computePreferredLocations
InputFormatInfo
computePrincipalComponents
RowMatrix
computeSVD
IndexedRowMatrix RowMatrix
concat
functions
concat_ws
functions
conf
SparkEnv SQLContext SQLSession SQLSession
confidence
Rule BoundedDouble
configuration
tree InputFormatInfo
configure
HiveContext
confusionMatrix
MulticlassMetrics
connectedComponents
GraphOps
consequent
Rule
contains
SparkConf ParamMap Column Metadata
containsBlock
StorageStatus
containsNull
ArrayType
context
InterruptibleIterator JavaRDDLike RDD JavaDStreamLike DStream
conv
functions
convertCTAS
HiveContext
convertMetastoreParquet
HiveContext
convertMetastoreParquetWithSchemaMerging
HiveContext
convertToCanonicalEdges
GraphOps
copy
Estimator Model Pipeline PipelineModel PipelineStage Predictor Transformer UnaryTransformer DecisionTreeClassificationModel DecisionTreeClassifier GBTClassificationModel GBTClassifier LogisticRegression LogisticRegressionModel MultilayerPerceptronClassificationModel MultilayerPerceptronClassifier NaiveBayes NaiveBayesModel OneVsRest OneVsRestModel RandomForestClassificationModel RandomForestClassifier KMeans KMeansModel BinaryClassificationEvaluator Evaluator MulticlassClassificationEvaluator RegressionEvaluator Binarizer Bucketizer CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel PolynomialExpansion RFormula RFormulaModel RegexTokenizer StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel Tokenizer VectorAssembler VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel ParamMap Params ALS ALSModel DecisionTreeRegressionModel DecisionTreeRegressor GBTRegressionModel GBTRegressor IsotonicRegression IsotonicRegressionModel LinearRegression LinearRegressionModel RandomForestRegressionModel RandomForestRegressor CrossValidator CrossValidatorModel TrainValidationSplit TrainValidationSplitModel DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector ExponentialGenerator GammaGenerator LogNormalGenerator PoissonGenerator RandomDataGenerator StandardNormalGenerator UniformGenerator Strategy Row ArrayBasedMapData ArrayData GenericArrayData MapData StatCounter
copyValues
Params
corr
Statistics DataFrameStatFunctions
cos
functions
cosh
functions
count
JavaRDDLike EdgeRDDImpl VertexRDDImpl MultivariateOnlineSummarizer MultivariateStatisticalSummary RDD DataFrame GroupedData functions JavaDStreamLike DStream OffsetRange StatCounter
countApprox
JavaRDDLike RDD
countApproxDistinct
JavaRDDLike RDD
countApproxDistinctByKey
JavaPairRDD PairRDDFunctions
countAsync
JavaRDDLike AsyncRDDActions
countByKey
JavaPairRDD PairRDDFunctions
countByKeyApprox
JavaPairRDD PairRDDFunctions
countByValue
JavaRDDLike RDD JavaDStreamLike DStream
countByValueAndWindow
JavaDStreamLike DStream
countByValueApprox
JavaRDDLike RDD
countByWindow
JavaDStreamLike DStream
countDistinct
functions
cov
DataFrameStatFunctions
crc32
functions
create
JdbcRDD PartitionPruningRDD JavaStreamingContextFactory Broker OffsetRange RateEstimator
createAggregator
Aggregator
createCombiner
Aggregator Combiner DefaultCombiner
createDataFrame
SQLContext
createDirectStream
KafkaUtils
createExternalTable
SQLContext
createJDBCTable
DataFrame
createLogDir
JobLogger
createLogWriter
JobLogger
createModel
LogisticRegressionWithLBFGS LogisticRegressionWithSGD SVMWithSGD GeneralizedLinearAlgorithm LassoWithSGD LinearRegressionWithSGD RidgeRegressionWithSGD
createPollingStream
FlumeUtils
createRDD
KafkaUtils
createRDDWithLocalProperties
DStream
createRelation
CreatableRelationProvider HadoopFsRelationProvider RelationProvider SchemaRelationProvider
createSession
SQLContext HiveContext
createStream
FlumeUtils KafkaUtils KinesisUtils MQTTUtils TwitterUtils ZeroMQUtils
createTransformFunc
UnaryTransformer DCT ElementwiseProduct NGram Normalizer PolynomialExpansion RegexTokenizer Tokenizer
crosstab
DataFrameStatFunctions
cube
DataFrame
cumeDist
functions
currentAttemptId
SparkStageInfo
currentSession
SQLContext
current_date
functions
current_timestamp
functions