Package org.apache.spark.sql.pipelines.graph

Interface GraphElement

All Known Subinterfaces:
Flow, Input, ResolutionCompletedFlow, ResolvedFlow, Sink, TableInput, View
All Known Implementing Classes:
AppendOnceFlow, CompleteFlow, PersistedView, ResolutionFailedFlow, SinkImpl, StreamingFlow, Table, TemporaryView, UnresolvedFlow, VirtualTableInput
public interface GraphElement
An element in a DataflowGraph.

  • Method Summary

    Modifier and Type
    Method
    Description
    String
    displayName()
    Returns a user-visible name for the element.
    org.apache.spark.sql.catalyst.TableIdentifier
    identifier()
    Returns the unique identifier for this GraphElement.
    QueryOrigin
    origin()
    Contains provenance to tie back this GraphElement to the user code that defined it.
    org.apache.spark.sql.classic.SparkSession
    spark()
     

  • Method Details

    • displayName

      String displayName()
      Returns a user-visible name for the element.
      Returns:
      (undocumented)

    • identifier

      org.apache.spark.sql.catalyst.TableIdentifier identifier()
      Returns the unique identifier for this GraphElement.

    • origin

      QueryOrigin origin()
      Contains provenance to tie back this GraphElement to the user code that defined it.

      This must be set when a GraphElement is directly created by some user code. Subsequently, this initial origin must be propagated as is without modification. If this GraphElement is copied or converted to a different type, then this origin must be copied as is.

      Returns:
      (undocumented)

    • spark

      org.apache.spark.sql.classic.SparkSession spark()