Package org.apache.spark.sql.connector.read.streaming

Class ReadMaxBytes

Object

org.apache.spark.sql.connector.read.streaming.ReadMaxBytes

All Implemented Interfaces:

ReadLimit

@Evolving
public class ReadMaxBytes
extends Object
implements ReadLimit

Represents a ReadLimit where the MicroBatchStream should scan files which total size doesn't go beyond a given maximum total size. Always reads at least one file so a stream can make progress and not get stuck on a file larger than a given maximum.

Since:

4.0.0

See Also:

• SupportsAdmissionControl.latestOffset(Offset, ReadLimit)

Method Summary

Modifier and Type	Method	Description
boolean	equals(Object o)
int	hashCode()
long	maxBytes()	Maximum total size of files to scan.
String	toString()

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Method Details

maxBytes

public long maxBytes()

Maximum total size of files to scan.

toString

public String toString()

Overrides:

toString in class Object

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object