Interface | Description |
---|---|
ContinuousPartitionReader<T> |
A variation on
PartitionReader for use with continuous streaming processing. |
ContinuousPartitionReaderFactory |
A variation on
PartitionReaderFactory that returns ContinuousPartitionReader
instead of PartitionReader . |
ContinuousStream |
A
SparkDataStream for streaming queries with continuous mode. |
MicroBatchStream |
A
SparkDataStream for streaming queries with micro-batch mode. |
PartitionOffset |
Used for per-partition offsets in continuous processing.
|
ReadLimit |
Interface representing limits on how much to read from a
MicroBatchStream when it
implements SupportsAdmissionControl . |
SparkDataStream |
The base interface representing a readable data stream in a Spark streaming query.
|
SupportsAdmissionControl |
A mix-in interface for
SparkDataStream streaming sources to signal that they can control
the rate of data ingested into the system. |
Class | Description |
---|---|
Offset |
An abstract representation of progress through a
MicroBatchStream or
ContinuousStream . |
ReadAllAvailable |
Represents a
ReadLimit where the MicroBatchStream must scan all the data
available at the streaming source. |
ReadMaxFiles |
Represents a
ReadLimit where the MicroBatchStream should scan approximately the
given maximum number of files. |
ReadMaxRows |
Represents a
ReadLimit where the MicroBatchStream should scan approximately the
given maximum number of rows. |