trait ResolvedFlow extends ResolutionCompletedFlow with Input
A Flow whose flow function has successfully resolved.
- Source
- Flow.scala
- Alphabetic
- By Inheritance
- ResolvedFlow
- Input
- ResolutionCompletedFlow
- Flow
- Logging
- GraphElement
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Type Members
- implicit class LogStringContext extends AnyRef
- Definition Classes
- Logging
Abstract Value Members
- abstract def flow: UnresolvedFlow
- Definition Classes
- ResolutionCompletedFlow
- abstract def funcResult: FlowFunctionResult
- Definition Classes
- ResolutionCompletedFlow
Concrete Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- def comment: Option[String]
The comment associated with this flow
The comment associated with this flow
- Definition Classes
- ResolutionCompletedFlow → Flow
- val destinationIdentifier: TableIdentifier
The dataset that this Flow represents a write to.
The dataset that this Flow represents a write to.
- Definition Classes
- ResolutionCompletedFlow → Flow
- def df: classic.DataFrame
The logical plan for this flow's query.
- def displayName: String
Returns a user-visible name for the element.
Returns a user-visible name for the element.
- Definition Classes
- GraphElement
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def func: FlowFunction
The FlowFunction containing the user's query.
The FlowFunction containing the user's query.
- Definition Classes
- ResolutionCompletedFlow → Flow
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- val identifier: TableIdentifier
Returns the unique identifier for this GraphElement.
Returns the unique identifier for this GraphElement.
- Definition Classes
- ResolutionCompletedFlow → Flow → GraphElement
- def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
- Attributes
- protected
- Definition Classes
- Logging
- def initializeLogIfNecessary(isInterpreter: Boolean): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def inputs: Set[TableIdentifier]
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def isTraceEnabled(): Boolean
- Attributes
- protected
- Definition Classes
- Logging
- def load(readOptions: InputReadOptions): classic.DataFrame
Returns a DataFrame that is a result of loading data from this Input.
Returns a DataFrame that is a result of loading data from this Input.
- readOptions
Type of input. Used to determine streaming/batch
- returns
Streaming or batch DataFrame of this Input's data.
- Definition Classes
- ResolvedFlow → Input
- def log: Logger
- Attributes
- protected
- Definition Classes
- Logging
- def logBasedOnLevel(level: Level)(f: => MessageWithContext): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logDebug(msg: => String, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logDebug(entry: LogEntry, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logDebug(entry: LogEntry): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logDebug(msg: => String): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logError(msg: => String, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logError(entry: LogEntry, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logError(entry: LogEntry): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logError(msg: => String): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logInfo(msg: => String, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logInfo(entry: LogEntry, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logInfo(entry: LogEntry): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logInfo(msg: => String): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logName: String
- Attributes
- protected
- Definition Classes
- Logging
- def logTrace(msg: => String, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logTrace(entry: LogEntry, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logTrace(entry: LogEntry): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logTrace(msg: => String): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logWarning(msg: => String, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logWarning(entry: LogEntry, throwable: Throwable): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logWarning(entry: LogEntry): Unit
- Attributes
- protected
- Definition Classes
- Logging
- def logWarning(msg: => String): Unit
- Attributes
- protected
- Definition Classes
- Logging
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- def once: Boolean
Whether this is a ONCE flow.
Whether this is a ONCE flow. ONCE flows should run only once per full refresh.
- Definition Classes
- Flow
- def origin: QueryOrigin
Contains provenance to tie back this GraphElement to the user code that defined it.
Contains provenance to tie back this GraphElement to the user code that defined it.
This must be set when a GraphElement is directly created by some user code. Subsequently, this initial origin must be propagated as is without modification. If this GraphElement is copied or converted to a different type, then this origin must be copied as is.
- Definition Classes
- ResolutionCompletedFlow → GraphElement
- def queryContext: QueryContext
The current query context (catalog and database) when the query is defined.
The current query context (catalog and database) when the query is defined.
- Definition Classes
- ResolutionCompletedFlow → Flow
- def schema: StructType
Returns the schema of the output of this Flow.
- def spark: classic.SparkSession
- Attributes
- protected
- Definition Classes
- GraphElement
- def sqlConf: Map[String, String]
- Definition Classes
- ResolutionCompletedFlow → Flow
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- def withLogContext(context: Map[String, String])(body: => Unit): Unit
- Attributes
- protected
- Definition Classes
- Logging
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)