org.apache.spark.sql.connector.write

Interface DeltaWriter<T>

All Superinterfaces:

AutoCloseable, java.io.Closeable, DataWriter<T>

@Experimental
public interface DeltaWriter<T>
extends DataWriter<T>

A data writer returned by DeltaWriterFactory.createWriter(int, long) and is responsible for writing a delta of rows.

Since:

3.4.0

Method Summary

Modifier and Type	Method and Description
void	delete(T metadata, T id) Deletes a row.
void	insert(T row) Inserts a new row.
void	update(T metadata, T id, T row) Updates a row.
default void	write(T row) Writes one record.

Methods inherited from interface org.apache.spark.sql.connector.write.DataWriter

abort, commit, currentMetricsValues

Methods inherited from interface java.io.Closeable

close

Method Detail

delete

void delete(T metadata,
            T id)
     throws java.io.IOException

Deletes a row.

Parameters:

metadata - values for metadata columns that were projected but are not part of the row ID

id - a row ID to delete

Throws:

java.io.IOException - if failure happens during disk/network IO like writing files

update

void update(T metadata,
            T id,
            T row)
     throws java.io.IOException

Updates a row.

Parameters:

metadata - values for metadata columns that were projected but are not part of the row ID

id - a row ID to update

row - a row with updated values

Throws:

java.io.IOException - if failure happens during disk/network IO like writing files

insert

void insert(T row)
     throws java.io.IOException

Inserts a new row.

Parameters:

row - a row to insert

Throws:

java.io.IOException - if failure happens during disk/network IO like writing files

write

default void write(T row)
            throws java.io.IOException

Description copied from interface: DataWriter

Writes one record.

If this method fails (by throwing an exception), DataWriter.abort() will be called and this data writer is considered to have been failed.

Specified by:

write in interface DataWriter<T>

Throws:

java.io.IOException - if failure happens during disk/network IO like writing files.