org.apache.spark.status

Class LiveEntityHelpers

Object

org.apache.spark.status.LiveEntityHelpers

public class LiveEntityHelpers
extends Object

Constructor Summary

Constructors

Constructor and Description
LiveEntityHelpers()

Method Summary

Modifier and Type	Method and Description
static TaskMetrics	addMetrics(TaskMetrics m1, TaskMetrics m2) Add m2 values to m1.
static TaskMetrics	createMetrics(long default_)
static TaskMetrics	createMetrics(long executorDeserializeTime, long executorDeserializeCpuTime, long executorRunTime, long executorCpuTime, long resultSize, long jvmGcTime, long resultSerializationTime, long memoryBytesSpilled, long diskBytesSpilled, long peakExecutionMemory, long inputBytesRead, long inputRecordsRead, long outputBytesWritten, long outputRecordsWritten, long shuffleRemoteBlocksFetched, long shuffleLocalBlocksFetched, long shuffleFetchWaitTime, long shuffleRemoteBytesRead, long shuffleRemoteBytesReadToDisk, long shuffleLocalBytesRead, long shuffleRecordsRead, long shuffleBytesWritten, long shuffleWriteTime, long shuffleRecordsWritten)
static scala.collection.Seq<AccumulableInfo>	newAccumulatorInfos(scala.collection.Iterable<AccumulableInfo> accums)
static TaskMetrics	subtractMetrics(TaskMetrics m1, TaskMetrics m2) Subtract m2 values from m1.
static String	weakIntern(String s) String interning to reduce the memory usage.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LiveEntityHelpers

public LiveEntityHelpers()

Method Detail

newAccumulatorInfos

public static scala.collection.Seq<AccumulableInfo> newAccumulatorInfos(scala.collection.Iterable<AccumulableInfo> accums)

weakIntern

public static String weakIntern(String s)

String interning to reduce the memory usage.

createMetrics

public static TaskMetrics createMetrics(long executorDeserializeTime,
                                        long executorDeserializeCpuTime,
                                        long executorRunTime,
                                        long executorCpuTime,
                                        long resultSize,
                                        long jvmGcTime,
                                        long resultSerializationTime,
                                        long memoryBytesSpilled,
                                        long diskBytesSpilled,
                                        long peakExecutionMemory,
                                        long inputBytesRead,
                                        long inputRecordsRead,
                                        long outputBytesWritten,
                                        long outputRecordsWritten,
                                        long shuffleRemoteBlocksFetched,
                                        long shuffleLocalBlocksFetched,
                                        long shuffleFetchWaitTime,
                                        long shuffleRemoteBytesRead,
                                        long shuffleRemoteBytesReadToDisk,
                                        long shuffleLocalBytesRead,
                                        long shuffleRecordsRead,
                                        long shuffleBytesWritten,
                                        long shuffleWriteTime,
                                        long shuffleRecordsWritten)

createMetrics

public static TaskMetrics createMetrics(long default_)

addMetrics

public static TaskMetrics addMetrics(TaskMetrics m1,
                                     TaskMetrics m2)

Add m2 values to m1.

subtractMetrics

public static TaskMetrics subtractMetrics(TaskMetrics m1,
                                          TaskMetrics m2)

Subtract m2 values from m1.