Interface | Description |
---|---|
GroupState<S> |
:: Experimental ::
|
PythonStreamingQueryListener |
Py4J allows a pure interface so this proxy is required.
|
StreamingQuery |
A handle to a query that is executing continuously in the background as new data arrives.
|
StreamingQueryListener.Event |
Base type of
StreamingQueryListener events |
TestGroupState<S> |
:: Experimental ::
|
Class | Description |
---|---|
DataStreamReader |
Interface used to load a streaming
Dataset from external storage systems (e.g. |
DataStreamWriter<T> |
Interface used to write a streaming
Dataset to external storage systems (e.g. |
GroupStateTimeout |
Represents the type of timeouts possible for the Dataset operations
mapGroupsWithState and flatMapGroupsWithState . |
OutputMode |
OutputMode describes what data will be written to a streaming sink when there is
new data available in a streaming DataFrame/Dataset.
|
SafeJsonSerializer | |
SinkProgress |
Information about progress made for a sink in the execution of a
StreamingQuery
during a trigger. |
SourceProgress |
Information about progress made for a source in the execution of a
StreamingQuery
during a trigger. |
StateOperatorProgress |
Information about updates made to stateful operators in a
StreamingQuery during a trigger. |
StreamingQueryListener |
Interface for listening to events related to
StreamingQueries . |
StreamingQueryListener.QueryProgressEvent |
Event representing any progress updates in a query.
|
StreamingQueryListener.QueryStartedEvent |
Event representing the start of a query
param: id A unique query id that persists across restarts.
|
StreamingQueryListener.QueryTerminatedEvent |
Event representing that termination of a query.
|
StreamingQueryManager |
A class to manage all the
StreamingQuery active in a SparkSession . |
StreamingQueryProgress |
Information about progress made in the execution of a
StreamingQuery during
a trigger. |
StreamingQueryStatus |
Reports information about the instantaneous status of a streaming query.
|
Trigger |
Policy used to indicate how often results should be produced by a [[StreamingQuery]].
|
Exception | Description |
---|---|
StreamingQueryException |
Exception that stopped a
StreamingQuery . |