org.apache.spark.sql.streaming
StreamingQuery
Related Doc:
package streaming
Waits for the termination of this query, either by query.stop() or by an exception.
Waits for the termination of this query, either by query.stop() or by an exception.
If the query has terminated with an exception, then the exception will be thrown.
Otherwise, it returns whether the query has terminated or not within the timeoutMs
milliseconds.
If the query has terminated, then all subsequent calls to this method will either return
true immediately (if the query was terminated by stop()), or throw the exception
immediately (if the query has terminated with exception).
2.0.0
StreamingQueryException, if this query has terminated with an exception
Waits for the termination of this query, either by query.stop() or by an exception.
Waits for the termination of this query, either by query.stop() or by an exception.
If the query has terminated with an exception, then the exception will be thrown.
If the query has terminated, then all subsequent calls to this method will either return
immediately (if the query was terminated by stop()), or throw the exception
immediately (if the query has terminated with exception).
2.0.0
StreamingQueryException, if this query has terminated with an exception.
Returns the StreamingQueryException if the query was terminated by an exception.
Returns the StreamingQueryException if the query was terminated by an exception.
2.0.0
Prints the physical plan to the console for debugging purposes.
Prints the physical plan to the console for debugging purposes.
whether to do extended explain or not
2.0.0
Prints the physical plan to the console for debugging purposes.
Prints the physical plan to the console for debugging purposes.
2.0.0
Returns the unique id of this query.
Returns the unique id of this query. This id is automatically generated and is unique across all queries that have been started in the current process.
2.0.0
Whether the query is currently active or not
Whether the query is currently active or not
2.0.0
Returns the name of the query.
Returns the name of the query. This name is unique across all active queries. This can be
set in the DataStreamWriter as
dataframe.writeStream.queryName("query").start().
2.0.0
Blocks until all available data in the source has been processed and committed to the sink.
Blocks until all available data in the source has been processed and committed to the sink.
This method is intended for testing. Note that in the case of continually arriving data, this
method may block forever. Additionally, this method is only guaranteed to block until data that
has been synchronously appended data to a org.apache.spark.sql.execution.streaming.Source
prior to invocation. (i.e. getOffset must immediately reflect the addition).
2.0.0
Returns the SparkSession associated with this.
Returns the SparkSession associated with this.
2.0.0
Returns the current status of the query.
Returns the current status of the query.
2.0.2
Stops the execution of this query if it is running.
Stops the execution of this query if it is running. This method blocks until the threads performing execution has stopped.
2.0.0
Returns current status of the sink.
Returns current status of the sink.
(Since version 2.0.2) use status.sinkStatus
2.0.0
Returns current status of all the sources.
Returns current status of all the sources.
(Since version 2.0.2) use status.sourceStatuses
2.0.0
:: Experimental :: A handle to a query that is executing continuously in the background as new data arrives. All these methods are thread-safe.
2.0.0