Package org.apache.spark.sql.streaming
package org.apache.spark.sql.streaming
-
ClassDescriptionInterface used to load a streaming
Datasetfrom external storage systems (e.g. file systems, key-value stores, etc).Interface used to write a streamingDatasetto external storage systems (e.g. file systems, key-value stores, etc).GroupState<S>:: Experimental ::Represents the type of timeouts possible for the Dataset operationsmapGroupsWithStateandflatMapGroupsWithState.OutputMode describes what data will be written to a streaming sink when there is new data available in a streaming DataFrame/Dataset.Py4J allows a pure interface so this proxy is required.Information about progress made for a sink in the execution of aStreamingQueryduring a trigger.Information about progress made for a source in the execution of aStreamingQueryduring a trigger.Information about updates made to stateful operators in aStreamingQueryduring a trigger.A handle to a query that is executing continuously in the background as new data arrives.Exception that stopped aStreamingQuery.Interface for listening to events related toStreamingQueries.Base type ofStreamingQueryListenereventsEvent representing that query is idle and waiting for new data to process.Event representing any progress updates in a query.Event representing the start of a query param: id A unique query id that persists across restarts.Event representing that termination of a query.A class to manage all theStreamingQueryactive in aSparkSession.Information about progress made in the execution of aStreamingQueryduring a trigger.Reports information about the instantaneous status of a streaming query.:: Experimental ::Policy used to indicate how often results should be produced by a [[StreamingQuery]].