Packages

c

org.apache.spark

ExceptionFailure

case class ExceptionFailure(className: String, description: String, stackTrace: Array[StackTraceElement], fullStackTrace: String, exceptionWrapper: Option[ThrowableSerializationWrapper], accumUpdates: Seq[AccumulableInfo] = Seq.empty, accums: Seq[AccumulatorV2[_, _]] = Nil, metricPeaks: Seq[Long] = Seq.empty) extends TaskFailedReason with Product with Serializable

Developer API

Task failed due to a runtime exception. This is the most common failure case and also captures user program exceptions.

stackTrace contains the stack trace of the exception itself. It still exists for backward compatibility. It's better to use this(e: Throwable, metrics: Option[TaskMetrics]) to create ExceptionFailure as it will handle the backward compatibility properly.

fullStackTrace is a better representation of the stack trace because it contains the whole stack trace including the exception and its causes

exception is the actual exception that caused the task to fail. It may be None in the case that the exception is not in fact serializable. If a task fails more than once (due to retries), exception is that one that caused the last failure.

Annotations
@DeveloperApi()
Source
TaskEndReason.scala
Linear Supertypes
Serializable, Serializable, Product, Equals, TaskFailedReason, TaskEndReason, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExceptionFailure
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. TaskFailedReason
  7. TaskEndReason
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ExceptionFailure(className: String, description: String, stackTrace: Array[StackTraceElement], fullStackTrace: String, exceptionWrapper: Option[ThrowableSerializationWrapper], accumUpdates: Seq[AccumulableInfo] = Seq.empty, accums: Seq[AccumulatorV2[_, _]] = Nil, metricPeaks: Seq[Long] = Seq.empty)

Value Members

  1. val accumUpdates: Seq[AccumulableInfo]
  2. val className: String
  3. def countTowardsTaskFailures: Boolean

    Whether this task failure should be counted towards the maximum number of times the task is allowed to fail before the stage is aborted.

    Whether this task failure should be counted towards the maximum number of times the task is allowed to fail before the stage is aborted. Set to false in cases where the task's failure was unrelated to the task; for example, if the task failed because the executor it was running on was killed.

    Definition Classes
    TaskFailedReason
  4. val description: String
  5. def exception: Option[Throwable]
  6. val fullStackTrace: String
  7. val stackTrace: Array[StackTraceElement]
  8. def toErrorString: String

    Error message displayed in the web UI.

    Error message displayed in the web UI.

    Definition Classes
    ExceptionFailureTaskFailedReason