Interface ResolutionCompletedFlow
- All Superinterfaces:
Flow
,GraphElement
,org.apache.spark.internal.Logging
- All Known Subinterfaces:
ResolvedFlow
- All Known Implementing Classes:
AppendOnceFlow
,CompleteFlow
,ResolutionFailedFlow
,StreamingFlow
A
Flow
whose flow function has been invoked, meaning either:
- Its output schema and dependencies are known.
- It failed to resolve.-
Nested Class Summary
Nested classes/interfaces inherited from interface org.apache.spark.internal.Logging
org.apache.spark.internal.Logging.LogStringContext, org.apache.spark.internal.Logging.SparkShellLoggingFilter
-
Method Summary
Modifier and TypeMethodDescriptionscala.Option<String>
comment()
The comment associated with this floworg.apache.spark.sql.catalyst.TableIdentifier
The dataset that this Flow represents a write to.flow()
func()
TheFlowFunction
containing the user's query.org.apache.spark.sql.catalyst.TableIdentifier
Returns the unique identifier for thisGraphElement
.origin()
Contains provenance to tie back this GraphElement to the user code that defined it.The current query context (catalog and database) when the query is defined.sqlConf()
Methods inherited from interface org.apache.spark.sql.pipelines.graph.GraphElement
displayName, spark
Methods inherited from interface org.apache.spark.internal.Logging
initializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, isTraceEnabled, log, logBasedOnLevel, logDebug, logDebug, logDebug, logDebug, logError, logError, logError, logError, logInfo, logInfo, logInfo, logInfo, logName, LogStringContext, logTrace, logTrace, logTrace, logTrace, logWarning, logWarning, logWarning, logWarning, org$apache$spark$internal$Logging$$log_, org$apache$spark$internal$Logging$$log__$eq, withLogContext
-
Method Details
-
comment
scala.Option<String> comment()Description copied from interface:Flow
The comment associated with this flow -
destinationIdentifier
org.apache.spark.sql.catalyst.TableIdentifier destinationIdentifier()Description copied from interface:Flow
The dataset that this Flow represents a write to.- Specified by:
destinationIdentifier
in interfaceFlow
- Returns:
- (undocumented)
-
flow
UnresolvedFlow flow() -
func
FlowFunction func()Description copied from interface:Flow
TheFlowFunction
containing the user's query. -
funcResult
FlowFunctionResult funcResult() -
identifier
org.apache.spark.sql.catalyst.TableIdentifier identifier()Description copied from interface:GraphElement
Returns the unique identifier for thisGraphElement
.- Specified by:
identifier
in interfaceFlow
- Specified by:
identifier
in interfaceGraphElement
-
origin
QueryOrigin origin()Description copied from interface:GraphElement
Contains provenance to tie back this GraphElement to the user code that defined it.This must be set when a
GraphElement
is directly created by some user code. Subsequently, this initial origin must be propagated as is without modification. If thisGraphElement
is copied or converted to a different type, then this origin must be copied as is.- Specified by:
origin
in interfaceGraphElement
- Returns:
- (undocumented)
-
queryContext
QueryContext queryContext()Description copied from interface:Flow
The current query context (catalog and database) when the query is defined.- Specified by:
queryContext
in interfaceFlow
-
sqlConf
-