spark

NarrowDependency

abstract class NarrowDependency[T] extends Dependency[T]

Base class for dependencies where each partition of the parent RDD is used by at most one partition of the child RDD. Narrow dependencies allow for pipelined execution.

Linear Supertypes
Dependency[T], Serializable, Serializable, AnyRef, Any
Known Subclasses
OneToOneDependency, PruneDependency, RangeDependency
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Hide All
  2. Show all
  1. NarrowDependency
  2. Dependency
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
Visibility
  1. Public
  2. All

Instance Constructors

  1. new NarrowDependency(rdd: RDD[T])

Abstract Value Members

  1. abstract def getParents(partitionId: Int): Seq[Int]

    Get the parent partitions for a child partition.

    Get the parent partitions for a child partition.

    partitionId

    a partition of the child RDD

    returns

    the partitions of the parent RDD that the child partition depends upon