Packages

c

org.apache.spark

ExceptionFailure

case class ExceptionFailure(className: String, description: String, stackTrace: Array[StackTraceElement], fullStackTrace: String, exceptionWrapper: Option[ThrowableSerializationWrapper], accumUpdates: Seq[AccumulableInfo] = Seq.empty, accums: Seq[AccumulatorV2[_, _]] = Nil, metricPeaks: Seq[Long] = Seq.empty) extends TaskFailedReason with Product with Serializable

:: DeveloperApi :: Task failed due to a runtime exception. This is the most common failure case and also captures user program exceptions.

stackTrace contains the stack trace of the exception itself. It still exists for backward compatibility. It's better to use this(e: Throwable, metrics: Option[TaskMetrics]) to create ExceptionFailure as it will handle the backward compatibility properly.

fullStackTrace is a better representation of the stack trace because it contains the whole stack trace including the exception and its causes

exception is the actual exception that caused the task to fail. It may be None in the case that the exception is not in fact serializable. If a task fails more than once (due to retries), exception is that one that caused the last failure.

Annotations
@DeveloperApi()
Source
TaskEndReason.scala
Linear Supertypes
Serializable, Serializable, Product, Equals, TaskFailedReason, TaskEndReason, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExceptionFailure
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. TaskFailedReason
  7. TaskEndReason
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ExceptionFailure(className: String, description: String, stackTrace: Array[StackTraceElement], fullStackTrace: String, exceptionWrapper: Option[ThrowableSerializationWrapper], accumUpdates: Seq[AccumulableInfo] = Seq.empty, accums: Seq[AccumulatorV2[_, _]] = Nil, metricPeaks: Seq[Long] = Seq.empty)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val accumUpdates: Seq[AccumulableInfo]
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. val className: String
  7. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  8. def countTowardsTaskFailures: Boolean

    Whether this task failure should be counted towards the maximum number of times the task is allowed to fail before the stage is aborted.

    Whether this task failure should be counted towards the maximum number of times the task is allowed to fail before the stage is aborted. Set to false in cases where the task's failure was unrelated to the task; for example, if the task failed because the executor it was running on was killed.

    Definition Classes
    TaskFailedReason
  9. val description: String
  10. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. def exception: Option[Throwable]
  12. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. val fullStackTrace: String
  14. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  17. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  18. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. val stackTrace: Array[StackTraceElement]
  20. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  21. def toErrorString: String

    Error message displayed in the web UI.

    Error message displayed in the web UI.

    Definition Classes
    ExceptionFailureTaskFailedReason
  22. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from TaskFailedReason

Inherited from TaskEndReason

Inherited from AnyRef

Inherited from Any

Ungrouped