org.apache.spark.sql.connector.write

Interface SupportsOverwriteV2

All Superinterfaces:

SupportsTruncate, WriteBuilder

All Known Subinterfaces:

SupportsOverwrite

@Evolving
public interface SupportsOverwriteV2
extends WriteBuilder, SupportsTruncate

Write builder trait for tables that support overwrite by filter.

Overwriting data by filter will delete any data that matches the filter and replace it with data that is committed in the write.

Since:

3.4.0

Method Summary

Modifier and Type	Method and Description
default boolean	canOverwrite(Predicate[] predicates) Checks whether it is possible to overwrite data from a data source table that matches filter expressions.
WriteBuilder	overwrite(Predicate[] predicates) Configures a write to replace data matching the filters with data committed in the write.
default WriteBuilder	truncate() Configures a write to replace all existing data with data committed in the write.

Methods inherited from interface org.apache.spark.sql.connector.write.WriteBuilder

build, buildForBatch, buildForStreaming

Method Detail

canOverwrite

default boolean canOverwrite(Predicate[] predicates)

Checks whether it is possible to overwrite data from a data source table that matches filter expressions.

Rows should be overwritten from the data source iff all of the filter expressions match. That is, the expressions must be interpreted as a set of filters that are ANDed together.

Parameters:

predicates - V2 filter expressions, used to match data to overwrite

Returns:

true if the delete operation can be performed

Since:

3.4.0

overwrite

WriteBuilder overwrite(Predicate[] predicates)

Configures a write to replace data matching the filters with data committed in the write.

Rows must be deleted from the data source if and only if all of the filters match. That is, filters must be interpreted as ANDed together.

Parameters:

predicates - filters used to match data to overwrite

Returns:

this write builder for method chaining

truncate

default WriteBuilder truncate()

Description copied from interface: SupportsTruncate

Configures a write to replace all existing data with data committed in the write.

Specified by:

truncate in interface SupportsTruncate

Returns:

this write builder for method chaining