Packages

t

org.apache.spark.sql.connector.write

SupportsOverwrite

trait SupportsOverwrite extends SupportsOverwriteV2

Write builder trait for tables that support overwrite by filter.

Overwriting data by filter will delete any data that matches the filter and replace it with data that is committed in the write.

Annotations
@Evolving()
Source
SupportsOverwrite.java
Since

3.0.0

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SupportsOverwrite
  2. SupportsOverwriteV2
  3. SupportsTruncate
  4. WriteBuilder
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Abstract Value Members

  1. abstract def overwrite(filters: Array[Filter]): WriteBuilder

    Configures a write to replace data matching the filters with data committed in the write.

    Configures a write to replace data matching the filters with data committed in the write.

    Rows must be deleted from the data source if and only if all of the filters match. That is, filters must be interpreted as ANDed together.

    filters

    filters used to match data to overwrite

    returns

    this write builder for method chaining

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def build(): Write

    Returns a logical Write shared between batch and streaming.

    Returns a logical Write shared between batch and streaming.

    Definition Classes
    WriteBuilder
    Since

    3.2.0

  6. def canOverwrite(predicates: Array[Predicate]): Boolean

    Checks whether it is possible to overwrite data from a data source table that matches filter expressions.

    Checks whether it is possible to overwrite data from a data source table that matches filter expressions.

    Rows should be overwritten from the data source iff all of the filter expressions match. That is, the expressions must be interpreted as a set of filters that are ANDed together.

    predicates

    V2 filter expressions, used to match data to overwrite

    returns

    true if the delete operation can be performed

    Definition Classes
    SupportsOverwriteSupportsOverwriteV2
    Since

    3.4.0

  7. def canOverwrite(filters: Array[Filter]): Boolean

    Checks whether it is possible to overwrite data from a data source table that matches filter expressions.

    Checks whether it is possible to overwrite data from a data source table that matches filter expressions.

    Rows should be overwritten from the data source iff all of the filter expressions match. That is, the expressions must be interpreted as a set of filters that are ANDed together.

    filters

    V2 filter expressions, used to match data to overwrite

    returns

    true if the delete operation can be performed

    Since

    3.4.0

  8. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  9. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  10. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  11. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  12. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  17. def overwrite(predicates: Array[Predicate]): WriteBuilder

    Configures a write to replace data matching the filters with data committed in the write.

    Configures a write to replace data matching the filters with data committed in the write.

    Rows must be deleted from the data source if and only if all of the filters match. That is, filters must be interpreted as ANDed together.

    predicates

    filters used to match data to overwrite

    returns

    this write builder for method chaining

    Definition Classes
    SupportsOverwriteSupportsOverwriteV2
  18. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. def truncate(): WriteBuilder

    Configures a write to replace all existing data with data committed in the write.

    Configures a write to replace all existing data with data committed in the write.

    returns

    this write builder for method chaining

    Definition Classes
    SupportsOverwriteSupportsOverwriteV2SupportsTruncate
    Annotations
    @Override()
  21. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  22. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  23. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def buildForBatch(): BatchWrite

    Returns a BatchWrite to write data to batch source.

    Returns a BatchWrite to write data to batch source.

    Definition Classes
    WriteBuilder
    Annotations
    @Deprecated
    Deprecated

    (Since version 3.2.0)

  2. def buildForStreaming(): StreamingWrite

    Returns a StreamingWrite to write data to streaming source.

    Returns a StreamingWrite to write data to streaming source.

    Definition Classes
    WriteBuilder
    Annotations
    @Deprecated
    Deprecated

    (Since version 3.2.0)

  3. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from SupportsOverwriteV2

Inherited from SupportsTruncate

Inherited from WriteBuilder

Inherited from AnyRef

Inherited from Any

Ungrouped