SpearmanCorrelation (Spark 4.1.0 JavaDoc)

org.apache.spark.mllib.stat.correlation.SpearmanCorrelation

public class SpearmanCorrelation extends Object

Compute Spearman's correlation for two RDDs of the type RDD[Double] or the correlation matrix for an RDD of the type RDD[Vector].

Definition of Spearman's correlation can be found at http://en.wikipedia.org/wiki/Spearman's_rank_correlation_coefficient

Constructor Summary

Constructors

Constructor

Description

SpearmanCorrelation()
Method Summary

Modifier and Type

Method

Description

static double

computeCorrelation(RDD<Object> x, RDD<Object> y)

Compute Spearman's correlation for two datasets.

static Matrix

computeCorrelationMatrix(RDD<Vector> X)

Compute Spearman's correlation matrix S, for the input matrix, where S(i, j) is the correlation between column i and j.

static double

computeCorrelationWithMatrixImpl(RDD<Object> x, RDD<Object> y)

static org.apache.spark.internal.Logging.LogStringContext

LogStringContext(scala.StringContext sc)

static org.slf4j.Logger

org$apache$spark$internal$Logging$$log_()

static void

org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)

Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details
- SpearmanCorrelation
  
  public SpearmanCorrelation()
Method Details
- computeCorrelation
  
  public static double computeCorrelation(RDD<Object> x, RDD<Object> y)
  
  Compute Spearman's correlation for two datasets.
  
  Parameters:
  
  x - (undocumented)
  
  y - (undocumented)
  
  Returns:
  
  (undocumented)
- computeCorrelationMatrix
  
  public static Matrix computeCorrelationMatrix(RDD<Vector> X)
  
  Compute Spearman's correlation matrix S, for the input matrix, where S(i, j) is the correlation between column i and j.
  
  Parameters:
  
  X - (undocumented)
  
  Returns:
  
  (undocumented)
- computeCorrelationWithMatrixImpl
  
  public static double computeCorrelationWithMatrixImpl(RDD<Object> x, RDD<Object> y)
- org$apache$spark$internal$Logging$$log_
  
  public static org.slf4j.Logger org$apache$spark$internal$Logging$$log_()
- org$apache$spark$internal$Logging$$log__$eq
  
  public static void org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)
- LogStringContext
  
  public static org.apache.spark.internal.Logging.LogStringContext LogStringContext(scala.StringContext sc)