Class HashPartitioner

Object
org.apache.spark.Partitioner
org.apache.spark.HashPartitioner
All Implemented Interfaces:
Serializable

public class HashPartitioner extends Partitioner
A Partitioner that implements hash-based partitioning using Java's Object.hashCode.

Java arrays have hashCodes that are based on the arrays' identities rather than their contents, so attempting to partition an RDD[Array[_} or RDD[(Array[_], _)] using a HashPartitioner will produce an unexpected or incorrect result.

See Also:
  • Constructor Details

    • HashPartitioner

      public HashPartitioner(int partitions)
  • Method Details