Packages

c

org.apache.spark

NarrowDependency

abstract class NarrowDependency[T] extends Dependency[T]

Developer API

Base class for dependencies where each partition of the child RDD depends on a small number of partitions of the parent RDD. Narrow dependencies allow for pipelined execution.

Annotations
@DeveloperApi()
Source
Dependency.scala
Linear Supertypes
Dependency[T], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. NarrowDependency
  2. Dependency
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new NarrowDependency(_rdd: RDD[T])

Abstract Value Members

  1. abstract def getParents(partitionId: Int): Seq[Int]

    Get the parent partitions for a child partition.

    Get the parent partitions for a child partition.

    partitionId

    a partition of the child RDD

    returns

    the partitions of the parent RDD that the child partition depends upon

Concrete Value Members

  1. def rdd: RDD[T]
    Definition Classes
    NarrowDependencyDependency