org.apache.spark.sql.connector.write

Interface SupportsDynamicOverwrite

All Superinterfaces:

WriteBuilder

@Evolving
public interface SupportsDynamicOverwrite
extends WriteBuilder

Write builder trait for tables that support dynamic partition overwrite.

A write that dynamically overwrites partitions removes all existing data in each logical partition for which the write will commit new data. Any existing logical partition for which the write does not contain data will remain unchanged.

This is provided to implement SQL compatible with Hive table operations but is not recommended. Instead, use the overwrite by filter API to explicitly replace data.

Since:

3.0.0

Method Summary

Modifier and Type	Method and Description
WriteBuilder	overwriteDynamicPartitions() Configures a write to dynamically replace partitions with data committed in the write.

Methods inherited from interface org.apache.spark.sql.connector.write.WriteBuilder

build, buildForBatch, buildForStreaming

Method Detail

overwriteDynamicPartitions

WriteBuilder overwriteDynamicPartitions()

Configures a write to dynamically replace partitions with data committed in the write.

Returns:

this write builder for method chaining