hadoop

apache

hadoopConfiguration

JavaSparkContext SparkContext

hadoopFile

JavaSparkContext SparkContext

HadoopMapReduceUtil

mapreduce

HadoopMapRedUtil

mapred

hadoopRDD

JavaSparkContext rdd SparkContext

HadoopWriter

mapred

hashCode

Aggregator Partition RuntimePercentage StageCompleted StageInfo RDDInfo StorageLevel

HashPartitioner

spark

hasNext

BlockFetcherIterator CompletionIterator

high

BoundedDouble

hours

StatsReportListener

html

common master worker storage

httpFileServer

SparkEnv