Class UnresolvedFlow
Object
org.apache.spark.sql.pipelines.graph.UnresolvedFlow
- All Implemented Interfaces:
Serializable
,org.apache.spark.internal.Logging
,Flow
,GraphElement
,scala.Equals
,scala.Product
A
Flow
whose output schema and dependencies aren't known.- See Also:
-
Nested Class Summary
Nested classes/interfaces inherited from interface org.apache.spark.internal.Logging
org.apache.spark.internal.Logging.LogStringContext, org.apache.spark.internal.Logging.SparkShellLoggingFilter
-
Constructor Summary
ConstructorsConstructorDescriptionUnresolvedFlow
(org.apache.spark.sql.catalyst.TableIdentifier identifier, org.apache.spark.sql.catalyst.TableIdentifier destinationIdentifier, FlowFunction func, QueryContext queryContext, scala.collection.immutable.Map<String, String> sqlConf, scala.Option<String> comment, boolean once, QueryOrigin origin) -
Method Summary
Modifier and TypeMethodDescriptionabstract static R
apply
(T1 v1, T2 v2, T3 v3, T4 v4, T5 v5, T6 v6, T7 v7, T8 v8) scala.Option<String>
comment()
The comment associated with this floworg.apache.spark.sql.catalyst.TableIdentifier
The dataset that this Flow represents a write to.func()
TheFlowFunction
containing the user's query.org.apache.spark.sql.catalyst.TableIdentifier
Returns the unique identifier for thisGraphElement
.boolean
once()
Whether this is a ONCE flow.origin()
Contains provenance to tie back this GraphElement to the user code that defined it.The current query context (catalog and database) when the query is defined.sqlConf()
static String
toString()
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
Methods inherited from interface scala.Equals
canEqual, equals
Methods inherited from interface org.apache.spark.sql.pipelines.graph.GraphElement
displayName, spark
Methods inherited from interface org.apache.spark.internal.Logging
initializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, isTraceEnabled, log, logBasedOnLevel, logDebug, logDebug, logDebug, logDebug, logError, logError, logError, logError, logInfo, logInfo, logInfo, logInfo, logName, LogStringContext, logTrace, logTrace, logTrace, logTrace, logWarning, logWarning, logWarning, logWarning, org$apache$spark$internal$Logging$$log_, org$apache$spark$internal$Logging$$log__$eq, withLogContext
Methods inherited from interface scala.Product
productArity, productElement, productElementName, productElementNames, productIterator, productPrefix
-
Constructor Details
-
UnresolvedFlow
public UnresolvedFlow(org.apache.spark.sql.catalyst.TableIdentifier identifier, org.apache.spark.sql.catalyst.TableIdentifier destinationIdentifier, FlowFunction func, QueryContext queryContext, scala.collection.immutable.Map<String, String> sqlConf, scala.Option<String> comment, boolean once, QueryOrigin origin)
-
-
Method Details
-
apply
public abstract static R apply(T1 v1, T2 v2, T3 v3, T4 v4, T5 v5, T6 v6, T7 v7, T8 v8) -
toString
-
identifier
public org.apache.spark.sql.catalyst.TableIdentifier identifier()Description copied from interface:GraphElement
Returns the unique identifier for thisGraphElement
.- Specified by:
identifier
in interfaceFlow
- Specified by:
identifier
in interfaceGraphElement
-
destinationIdentifier
public org.apache.spark.sql.catalyst.TableIdentifier destinationIdentifier()Description copied from interface:Flow
The dataset that this Flow represents a write to.- Specified by:
destinationIdentifier
in interfaceFlow
- Returns:
- (undocumented)
-
func
Description copied from interface:Flow
TheFlowFunction
containing the user's query. -
queryContext
Description copied from interface:Flow
The current query context (catalog and database) when the query is defined.- Specified by:
queryContext
in interfaceFlow
-
sqlConf
-
comment
Description copied from interface:Flow
The comment associated with this flow -
once
public boolean once()Description copied from interface:Flow
Whether this is a ONCE flow. ONCE flows should run only once per full refresh. -
origin
Description copied from interface:GraphElement
Contains provenance to tie back this GraphElement to the user code that defined it.This must be set when a
GraphElement
is directly created by some user code. Subsequently, this initial origin must be propagated as is without modification. If thisGraphElement
is copied or converted to a different type, then this origin must be copied as is.- Specified by:
origin
in interfaceGraphElement
- Returns:
- (undocumented)
-