Packages

trait LogicalWriteInfo extends AnyRef

This interface contains logical write information that data sources can use when generating a WriteBuilder.

Annotations
@Evolving()
Source
LogicalWriteInfo.java
Since

3.0.0

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. LogicalWriteInfo
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Abstract Value Members

  1. abstract def options(): CaseInsensitiveStringMap

    the options that the user specified when writing the dataset

  2. abstract def queryId(): String

    queryId is a unique string of the query.

    queryId is a unique string of the query. It's possible that there are many queries running at the same time, or a query is restarted and resumed. BatchWrite can use this id to identify the query.

  3. abstract def schema(): StructType

    the schema of the input data from Spark to data source.

Concrete Value Members

  1. def metadataSchema(): Optional[StructType]

    the schema of the input metadata from Spark to data source.

  2. def rowIdSchema(): Optional[StructType]

    the schema of the ID columns from Spark to data source.