Packages

  • package root
    Definition Classes
    root
  • package org
    Definition Classes
    root
  • package apache
    Definition Classes
    org
  • package spark

    Core Spark functionality.

    Core Spark functionality. org.apache.spark.SparkContext serves as the main entry point to Spark, while org.apache.spark.rdd.RDD is the data type representing a distributed collection, and provides most parallel operations.

    In addition, org.apache.spark.rdd.PairRDDFunctions contains operations available only on RDDs of key-value pairs, such as groupByKey and join; org.apache.spark.rdd.DoubleRDDFunctions contains operations available only on RDDs of Doubles; and org.apache.spark.rdd.SequenceFileRDDFunctions contains operations available on RDDs that can be saved as SequenceFiles. These operations are automatically available on any RDD of the right type (e.g. RDD[(Int, Int)] through implicit conversions.

    Java programmers should reference the org.apache.spark.api.java package for Spark programming APIs in Java.

    Classes and methods marked with Experimental are user-facing features which have not been officially adopted by the Spark project. These are subject to change or removal in minor releases.

    Classes and methods marked with Developer API are intended for advanced users want to extend Spark through lower level interfaces. These are subject to changes or removal in minor releases.

    Definition Classes
    apache
  • package ml

    DataFrame-based machine learning APIs to let users quickly assemble and configure practical machine learning pipelines.

    DataFrame-based machine learning APIs to let users quickly assemble and configure practical machine learning pipelines.

    Definition Classes
    spark
  • package linalg
    Definition Classes
    ml
  • DenseMatrix
  • DenseVector
  • Matrices
  • Matrix
  • SQLDataTypes
  • SparseMatrix
  • SparseVector
  • Vector
  • Vectors

sealed trait Matrix extends Serializable

Trait for a local matrix.

Annotations
@Since("2.0.0")
Source
Matrices.scala
Linear Supertypes
Serializable, AnyRef, Any
Known Subclasses
DenseMatrix, SparseMatrix
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Matrix
  2. Serializable
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Abstract Value Members

  1. abstract def apply(i: Int, j: Int): Double

    Gets the (i, j)-th element.

    Gets the (i, j)-th element.

    Annotations
    @Since("2.0.0")
  2. abstract def colIter: Iterator[Vector]

    Returns an iterator of column vectors.

    Returns an iterator of column vectors. This operation could be expensive, depending on the underlying storage.

    Annotations
    @Since("2.0.0")
  3. abstract def copy: Matrix

    Get a deep copy of the matrix.

    Get a deep copy of the matrix.

    Annotations
    @Since("2.0.0")
  4. abstract def foreachActive(f: (Int, Int, Double) => Unit): Unit

    Applies a function f to all the active elements of dense and sparse matrix.

    Applies a function f to all the active elements of dense and sparse matrix. The ordering of the elements are not defined.

    f

    the function takes three parameters where the first two parameters are the row and column indices respectively with the type Int, and the final parameter is the corresponding value in the matrix with type Double.

    Annotations
    @Since("2.2.0")
  5. abstract def numActives: Int

    Find the number of values stored explicitly.

    Find the number of values stored explicitly. These values can be zero as well.

    Annotations
    @Since("2.0.0")
  6. abstract def numCols: Int

    Number of columns.

    Number of columns.

    Annotations
    @Since("2.0.0")
  7. abstract def numNonzeros: Int

    Find the number of non-zero active values.

    Find the number of non-zero active values.

    Annotations
    @Since("2.0.0")
  8. abstract def numRows: Int

    Number of rows.

    Number of rows.

    Annotations
    @Since("2.0.0")
  9. abstract def transpose: Matrix

    Transpose the Matrix.

    Transpose the Matrix. Returns a new Matrix instance sharing the same underlying data.

    Annotations
    @Since("2.0.0")

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  6. def compressed: Matrix

    Returns a matrix in dense column major, dense row major, sparse row major, or sparse column major format, whichever uses less storage.

    Returns a matrix in dense column major, dense row major, sparse row major, or sparse column major format, whichever uses less storage. When dense representation is optimal, it maintains the current layout order.

    Annotations
    @Since("2.2.0")
  7. def compressedColMajor: Matrix

    Returns a matrix in dense or sparse column major format, whichever uses less storage.

    Returns a matrix in dense or sparse column major format, whichever uses less storage.

    Annotations
    @Since("2.2.0")
  8. def compressedRowMajor: Matrix

    Returns a matrix in dense or sparse row major format, whichever uses less storage.

    Returns a matrix in dense or sparse row major format, whichever uses less storage.

    Annotations
    @Since("2.2.0")
  9. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  10. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  11. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  12. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. val isTransposed: Boolean

    Flag that keeps track whether the matrix is transposed or not.

    Flag that keeps track whether the matrix is transposed or not. False by default.

    Annotations
    @Since("2.0.0")
  15. def multiply(y: Vector): DenseVector

    Convenience method for Matrix-Vector multiplication.

    Convenience method for Matrix-Vector multiplication.

    Annotations
    @Since("2.0.0")
  16. def multiply(y: DenseVector): DenseVector

    Convenience method for Matrix-DenseVector multiplication.

    Convenience method for Matrix-DenseVector multiplication. For binary compatibility.

    Annotations
    @Since("2.0.0")
  17. def multiply(y: DenseMatrix): DenseMatrix

    Convenience method for Matrix-DenseMatrix multiplication.

    Convenience method for Matrix-DenseMatrix multiplication.

    Annotations
    @Since("2.0.0")
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  21. def rowIter: Iterator[Vector]

    Returns an iterator of row vectors.

    Returns an iterator of row vectors. This operation could be expensive, depending on the underlying storage.

    Annotations
    @Since("2.0.0")
  22. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  23. def toArray: Array[Double]

    Converts to a dense array in column major.

    Converts to a dense array in column major.

    Annotations
    @Since("2.0.0")
  24. def toDense: DenseMatrix

    Converts this matrix to a dense matrix while maintaining the layout of the current matrix.

    Converts this matrix to a dense matrix while maintaining the layout of the current matrix.

    Annotations
    @Since("2.2.0")
  25. def toDenseColMajor: DenseMatrix

    Converts this matrix to a dense matrix in column major order.

    Converts this matrix to a dense matrix in column major order.

    Annotations
    @Since("2.2.0")
  26. def toDenseRowMajor: DenseMatrix

    Converts this matrix to a dense matrix in row major order.

    Converts this matrix to a dense matrix in row major order.

    Annotations
    @Since("2.2.0")
  27. def toSparse: SparseMatrix

    Converts this matrix to a sparse matrix while maintaining the layout of the current matrix.

    Converts this matrix to a sparse matrix while maintaining the layout of the current matrix.

    Annotations
    @Since("2.2.0")
  28. def toSparseColMajor: SparseMatrix

    Converts this matrix to a sparse matrix in column major order.

    Converts this matrix to a sparse matrix in column major order.

    Annotations
    @Since("2.2.0")
  29. def toSparseRowMajor: SparseMatrix

    Converts this matrix to a sparse matrix in row major order.

    Converts this matrix to a sparse matrix in row major order.

    Annotations
    @Since("2.2.0")
  30. def toString(maxLines: Int, maxLineWidth: Int): String

    A human readable representation of the matrix with maximum lines and width

    A human readable representation of the matrix with maximum lines and width

    Annotations
    @Since("2.0.0")
  31. def toString(): String

    A human readable representation of the matrix

    A human readable representation of the matrix

    Definition Classes
    Matrix → AnyRef → Any
  32. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  33. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  34. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Members