public class StageInfo
extends Object
Constructor and Description |
---|
StageInfo(int stageId,
String name,
int numTasks,
scala.collection.Seq<RDDInfo> rddInfos) |
Modifier and Type | Method and Description |
---|---|
scala.Option<Object> |
completionTime()
Time when all tasks in the stage completed or when the stage was cancelled.
|
boolean |
emittedTaskSizeWarning() |
scala.Option<String> |
failureReason()
If the stage failed, the reason why.
|
static StageInfo |
fromStage(org.apache.spark.scheduler.Stage stage)
Construct a StageInfo from a Stage.
|
String |
name() |
int |
numTasks() |
scala.collection.Seq<RDDInfo> |
rddInfos() |
void |
stageFailed(String reason) |
int |
stageId() |
scala.Option<Object> |
submissionTime()
When this stage was submitted from the DAGScheduler to a TaskScheduler.
|
public StageInfo(int stageId, String name, int numTasks, scala.collection.Seq<RDDInfo> rddInfos)
public static StageInfo fromStage(org.apache.spark.scheduler.Stage stage)
Each Stage is associated with one or many RDDs, with the boundary of a Stage marked by shuffle dependencies. Therefore, all ancestor RDDs related to this Stage's RDD through a sequence of narrow dependencies should also be associated with this Stage.
public int stageId()
public String name()
public int numTasks()
public scala.collection.Seq<RDDInfo> rddInfos()
public scala.Option<Object> submissionTime()
public scala.Option<Object> completionTime()
public scala.Option<String> failureReason()
public boolean emittedTaskSizeWarning()
public void stageFailed(String reason)