class BatchTableWrite extends FlowExecution
- Alphabetic
- By Inheritance
- BatchTableWrite
- FlowExecution
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new BatchTableWrite(identifier: TableIdentifier, flow: ResolvedFlow, graph: DataflowGraph, destination: Table, updateContext: PipelineUpdateContext, sqlConf: Map[String, String])
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- val destination: Table
The destination that this
FlowExecutionis writing to.The destination that this
FlowExecutionis writing to.- Definition Classes
- BatchTableWrite → FlowExecution
- final def displayName: String
Returns a user-visible name for the flow.
Returns a user-visible name for the flow.
- Definition Classes
- FlowExecution
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def exception: Option[Throwable]
Returns an optional exception that occurred during execution, if any.
Returns an optional exception that occurred during execution, if any.
- Definition Classes
- FlowExecution
- final def executeAsync(): Unit
Executes this FlowExecution asynchronously to perform its intended update.
Executes this FlowExecution asynchronously to perform its intended update. A future that can be used to track execution status is saved, and can be retrieved with
getFuture.- Definition Classes
- FlowExecution
- def executeInternal(): Future[Unit]
Executes this FlowExecution synchronously to perform its intended update.
Executes this FlowExecution synchronously to perform its intended update. This method should be overridden by subclasses to provide the actual execution logic.
- returns
a Future that completes when the execution is finished or stopped.
- Definition Classes
- BatchTableWrite → FlowExecution
- implicit val executionContext: ExecutionContext
The thread execution context for the current
FlowExecution.The thread execution context for the current
FlowExecution.- Definition Classes
- FlowExecution
- val flow: ResolvedFlow
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- def getFuture: Future[ExecutionResult]
Retrieves the future that can be used to track execution status.
Retrieves the future that can be used to track execution status.
- Definition Classes
- FlowExecution
- def getOrigin: QueryOrigin
Origin to use when recording events for this flow.
Origin to use when recording events for this flow.
- Definition Classes
- BatchTableWrite → FlowExecution
- val graph: DataflowGraph
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- val identifier: TableIdentifier
Identifier of this physical flow
Identifier of this physical flow
- Definition Classes
- BatchTableWrite → FlowExecution
- def isCompleted: Boolean
Returns true if and only if this
FlowExecutionhas been completed with either success or an exception.Returns true if and only if this
FlowExecutionhas been completed with either success or an exception.- Definition Classes
- FlowExecution
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def isStreaming: Boolean
Returns true iff this
FlowExecutionexecutes using Spark Structured Streaming.Returns true iff this
FlowExecutionexecutes using Spark Structured Streaming.- Definition Classes
- BatchTableWrite → FlowExecution
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- def spark: classic.SparkSession
SparkSession to execute this physical flow with.
SparkSession to execute this physical flow with.
The default value for streaming flows is the pipeline's spark session because the source dataframe is resolved using the pipeline's spark session, and a new session will be started implicitly by the streaming query.
The default value for batch flows is a cloned spark session from the pipeline's spark session.
Please make sure that the execution thread runs in a different spark session than the pipeline's spark session.
- Attributes
- protected
- Definition Classes
- FlowExecution
- val sqlConf: Map[String, String]
- def stop(): Unit
Stops execution of this
FlowExecution.Stops execution of this
FlowExecution. If you override this, please be sure to callsuper.stop()at the beginning of your method, so we can properly handle errors when a user tries to stop a flow.- Definition Classes
- FlowExecution
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- val updateContext: PipelineUpdateContext
Context about this pipeline update.
Context about this pipeline update.
- Definition Classes
- BatchTableWrite → FlowExecution
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)