public class LiveRDD
extends Object
The RDD storage level is immutable, following the current behavior of RDD.persist(), even
though it is mutable in the RDDInfo structure. Since the listener does not track unpersisted
RDDs, this covers the case where an early stage is run on the unpersisted RDD, and a later stage
it started after the RDD is marked for caching.
| Constructor and Description |
|---|
LiveRDD(RDDInfo info,
StorageLevel storageLevel) |
| Modifier and Type | Method and Description |
|---|---|
long |
diskUsed() |
LiveRDDDistribution |
distribution(org.apache.spark.status.LiveExecutor exec) |
scala.Option<LiveRDDDistribution> |
distributionOpt(org.apache.spark.status.LiveExecutor exec) |
scala.collection.Map<String,LiveRDDDistribution> |
getDistributions() |
scala.collection.Map<String,LiveRDDPartition> |
getPartitions() |
RDDInfo |
info() |
long |
lastWriteTime() |
long |
memoryUsed() |
LiveRDDPartition |
partition(String blockName) |
boolean |
removeDistribution(org.apache.spark.status.LiveExecutor exec) |
void |
removePartition(String blockName) |
void |
write(org.apache.spark.status.ElementTrackingStore store,
long now,
boolean checkTriggers) |
public LiveRDD(RDDInfo info, StorageLevel storageLevel)
public long diskUsed()
public LiveRDDDistribution distribution(org.apache.spark.status.LiveExecutor exec)
public scala.Option<LiveRDDDistribution> distributionOpt(org.apache.spark.status.LiveExecutor exec)
public scala.collection.Map<String,LiveRDDDistribution> getDistributions()
public scala.collection.Map<String,LiveRDDPartition> getPartitions()
public RDDInfo info()
public long memoryUsed()
public LiveRDDPartition partition(String blockName)
public boolean removeDistribution(org.apache.spark.status.LiveExecutor exec)
public void removePartition(String blockName)
public long lastWriteTime()
public void write(org.apache.spark.status.ElementTrackingStore store,
long now,
boolean checkTriggers)