org.apache.spark.sql.connector.write

Interface DeltaBatchWrite

All Superinterfaces:

BatchWrite

@Experimental
public interface DeltaBatchWrite
extends BatchWrite

An interface that defines how to write a delta of rows during batch processing.

Since:

3.4.0

Method Summary

Modifier and Type	Method and Description
DeltaWriterFactory	createBatchWriterFactory(PhysicalWriteInfo info) Creates a writer factory which will be serialized and sent to executors.

Methods inherited from interface org.apache.spark.sql.connector.write.BatchWrite

abort, commit, onDataWriterCommit, useCommitCoordinator

Method Detail

createBatchWriterFactory

DeltaWriterFactory createBatchWriterFactory(PhysicalWriteInfo info)

Description copied from interface: BatchWrite

Creates a writer factory which will be serialized and sent to executors.

If this method fails (by throwing an exception), the action will fail and no Spark job will be submitted.

Specified by:

createBatchWriterFactory in interface BatchWrite

Parameters:

info - Physical information about the input data that will be written to this table.