org.apache.spark.sql.pipelines.graph
DataflowGraphTransformer
Companion class DataflowGraphTransformer
object DataflowGraphTransformer
- Alphabetic
- By Inheritance
- DataflowGraphTransformer
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Type Members
- case class TransformNodeFailedException(failedNode: ResolutionFailedFlow) extends Exception with NoStackTrace with Product with Serializable
Exception thrown when transforming a node in the graph fails with a non-retryable error.
Exception thrown when transforming a node in the graph fails with a non-retryable error.
- failedNode
The failed node that could not be transformed.
- case class TransformNodeRetryableException(datasetIdentifier: TableIdentifier, failedNode: ResolutionFailedFlow) extends Exception with NoStackTrace with Product with Serializable
Exception thrown when transforming a node in the graph fails because at least one of its dependencies weren't yet transformed.
Exception thrown when transforming a node in the graph fails because at least one of its dependencies weren't yet transformed.
- datasetIdentifier
The identifier for an untransformed dependency table identifier in the dataflow graph.
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- def withDataflowGraphTransformer[T](graph: DataflowGraph)(f: (DataflowGraphTransformer) => T): T
Autocloseable wrapper around DataflowGraphTransformer to ensure that the transformer is closed without clients needing to remember to close it.
Autocloseable wrapper around DataflowGraphTransformer to ensure that the transformer is closed without clients needing to remember to close it. It takes in the same arguments as DataflowGraphTransformer constructor. It exposes the DataflowGraphTransformer instance within the callable scope.
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)