Packages

  • package root
    Definition Classes
    root
  • package org
    Definition Classes
    root
  • package apache
    Definition Classes
    org
  • package spark

    Core Spark functionality.

    Core Spark functionality. org.apache.spark.SparkContext serves as the main entry point to Spark, while org.apache.spark.rdd.RDD is the data type representing a distributed collection, and provides most parallel operations.

    In addition, org.apache.spark.rdd.PairRDDFunctions contains operations available only on RDDs of key-value pairs, such as groupByKey and join; org.apache.spark.rdd.DoubleRDDFunctions contains operations available only on RDDs of Doubles; and org.apache.spark.rdd.SequenceFileRDDFunctions contains operations available on RDDs that can be saved as SequenceFiles. These operations are automatically available on any RDD of the right type (e.g. RDD[(Int, Int)] through implicit conversions.

    Java programmers should reference the org.apache.spark.api.java package for Spark programming APIs in Java.

    Classes and methods marked with Experimental are user-facing features which have not been officially adopted by the Spark project. These are subject to change or removal in minor releases.

    Classes and methods marked with Developer API are intended for advanced users want to extend Spark through lower level interfaces. These are subject to changes or removal in minor releases.

    Definition Classes
    apache
  • package ml

    DataFrame-based machine learning APIs to let users quickly assemble and configure practical machine learning pipelines.

    DataFrame-based machine learning APIs to let users quickly assemble and configure practical machine learning pipelines.

    Definition Classes
    spark
  • package linalg
    Definition Classes
    ml
  • DenseMatrix
  • DenseVector
  • Matrices
  • Matrix
  • SQLDataTypes
  • SparseMatrix
  • SparseVector
  • Vector
  • Vectors

class DenseMatrix extends Matrix

Column-major dense matrix. The entry values are stored in a single array of doubles with columns listed in sequence. For example, the following matrix

1.0 2.0
3.0 4.0
5.0 6.0

is stored as [1.0, 3.0, 5.0, 2.0, 4.0, 6.0].

Annotations
@Since("2.0.0")
Source
Matrices.scala
Linear Supertypes
Matrix, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DenseMatrix
  2. Matrix
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new DenseMatrix(numRows: Int, numCols: Int, values: Array[Double])

    Column-major dense matrix.

    Column-major dense matrix. The entry values are stored in a single array of doubles with columns listed in sequence. For example, the following matrix

    1.0 2.0
3.0 4.0
5.0 6.0

    is stored as [1.0, 3.0, 5.0, 2.0, 4.0, 6.0].

    numRows

    number of rows

    numCols

    number of columns

    values

    matrix entries in column major

    Annotations
    @Since("2.0.0")
  2. new DenseMatrix(numRows: Int, numCols: Int, values: Array[Double], isTransposed: Boolean)

    numRows

    number of rows

    numCols

    number of columns

    values

    matrix entries in column major if not transposed or in row major otherwise

    isTransposed

    whether the matrix is transposed. If true, values stores the matrix in row major.

    Annotations
    @Since("2.0.0")

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def apply(i: Int, j: Int): Double

    Gets the (i, j)-th element.

    Gets the (i, j)-th element.

    Definition Classes
    DenseMatrix → Matrix
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  7. def colIter: Iterator[Vector]

    Returns an iterator of column vectors.

    Returns an iterator of column vectors. This operation could be expensive, depending on the underlying storage.

    Definition Classes
    DenseMatrix → Matrix
  8. def compressed: Matrix

    Returns a matrix in dense column major, dense row major, sparse row major, or sparse column major format, whichever uses less storage.

    Returns a matrix in dense column major, dense row major, sparse row major, or sparse column major format, whichever uses less storage. When dense representation is optimal, it maintains the current layout order.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  9. def compressedColMajor: Matrix

    Returns a matrix in dense or sparse column major format, whichever uses less storage.

    Returns a matrix in dense or sparse column major format, whichever uses less storage.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  10. def compressedRowMajor: Matrix

    Returns a matrix in dense or sparse row major format, whichever uses less storage.

    Returns a matrix in dense or sparse row major format, whichever uses less storage.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  11. def copy: DenseMatrix

    Get a deep copy of the matrix.

    Get a deep copy of the matrix.

    Definition Classes
    DenseMatrix → Matrix
  12. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. def equals(o: Any): Boolean
    Definition Classes
    DenseMatrix → AnyRef → Any
  14. def foreachActive(f: (Int, Int, Double) => Unit): Unit

    Applies a function f to all the active elements of dense and sparse matrix.

    Applies a function f to all the active elements of dense and sparse matrix. The ordering of the elements are not defined.

    f

    the function takes three parameters where the first two parameters are the row and column indices respectively with the type Int, and the final parameter is the corresponding value in the matrix with type Double.

    Definition Classes
    DenseMatrix → Matrix
  15. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  16. def hashCode(): Int
    Definition Classes
    DenseMatrix → AnyRef → Any
  17. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  18. val isTransposed: Boolean

    Flag that keeps track whether the matrix is transposed or not.

    Flag that keeps track whether the matrix is transposed or not. False by default.

    Definition Classes
    DenseMatrix → Matrix
  19. def multiply(y: Vector): DenseVector

    Convenience method for Matrix-Vector multiplication.

    Convenience method for Matrix-Vector multiplication.

    Definition Classes
    Matrix
    Annotations
    @Since("2.0.0")
  20. def multiply(y: DenseVector): DenseVector

    Convenience method for Matrix-DenseVector multiplication.

    Convenience method for Matrix-DenseVector multiplication. For binary compatibility.

    Definition Classes
    Matrix
    Annotations
    @Since("2.0.0")
  21. def multiply(y: DenseMatrix): DenseMatrix

    Convenience method for Matrix-DenseMatrix multiplication.

    Convenience method for Matrix-DenseMatrix multiplication.

    Definition Classes
    Matrix
    Annotations
    @Since("2.0.0")
  22. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  23. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  24. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  25. def numActives: Int

    Find the number of values stored explicitly.

    Find the number of values stored explicitly. These values can be zero as well.

    Definition Classes
    DenseMatrix → Matrix
  26. val numCols: Int

    Number of columns.

    Number of columns.

    Definition Classes
    DenseMatrix → Matrix
    Annotations
    @Since("2.0.0")
  27. def numNonzeros: Int

    Find the number of non-zero active values.

    Find the number of non-zero active values.

    Definition Classes
    DenseMatrix → Matrix
  28. val numRows: Int

    Number of rows.

    Number of rows.

    Definition Classes
    DenseMatrix → Matrix
    Annotations
    @Since("2.0.0")
  29. def rowIter: Iterator[Vector]

    Returns an iterator of row vectors.

    Returns an iterator of row vectors. This operation could be expensive, depending on the underlying storage.

    Definition Classes
    Matrix
    Annotations
    @Since("2.0.0")
  30. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  31. def toArray: Array[Double]

    Converts to a dense array in column major.

    Converts to a dense array in column major.

    Definition Classes
    Matrix
    Annotations
    @Since("2.0.0")
  32. def toDense: DenseMatrix

    Converts this matrix to a dense matrix while maintaining the layout of the current matrix.

    Converts this matrix to a dense matrix while maintaining the layout of the current matrix.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  33. def toDenseColMajor: DenseMatrix

    Converts this matrix to a dense matrix in column major order.

    Converts this matrix to a dense matrix in column major order.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  34. def toDenseRowMajor: DenseMatrix

    Converts this matrix to a dense matrix in row major order.

    Converts this matrix to a dense matrix in row major order.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  35. def toSparse: SparseMatrix

    Converts this matrix to a sparse matrix while maintaining the layout of the current matrix.

    Converts this matrix to a sparse matrix while maintaining the layout of the current matrix.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  36. def toSparseColMajor: SparseMatrix

    Converts this matrix to a sparse matrix in column major order.

    Converts this matrix to a sparse matrix in column major order.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  37. def toSparseRowMajor: SparseMatrix

    Converts this matrix to a sparse matrix in row major order.

    Converts this matrix to a sparse matrix in row major order.

    Definition Classes
    Matrix
    Annotations
    @Since("2.2.0")
  38. def toString(maxLines: Int, maxLineWidth: Int): String

    A human readable representation of the matrix with maximum lines and width

    A human readable representation of the matrix with maximum lines and width

    Definition Classes
    Matrix
    Annotations
    @Since("2.0.0")
  39. def toString(): String

    A human readable representation of the matrix

    A human readable representation of the matrix

    Definition Classes
    Matrix → AnyRef → Any
  40. def transpose: DenseMatrix

    Transpose the Matrix.

    Transpose the Matrix. Returns a new Matrix instance sharing the same underlying data.

    Definition Classes
    DenseMatrix → Matrix
  41. val values: Array[Double]
    Annotations
    @Since("2.0.0")
  42. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  43. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  44. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from Matrix

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Members