Package org.apache.spark.sql.pipelines.graph

Interface Dataset

All Superinterfaces:
Output
All Known Implementing Classes:
Table
public interface Dataset extends Output
A type of Output that represents a materialized dataset in a DataflowGraph.

  • Method Summary

    Modifier and Type
    Method
    Description
    boolean
    normalized()
    Return whether the storage location for this Output has been normalized.
    scala.Option<String>
    normalizedPath()
    Normalized storage location used for storing materializations for this Output.
    String
    path()
    Return the normalized storage location for this Output and throw if the storage location has not been normalized.

  • Method Details

    • normalized

      boolean normalized()
      Return whether the storage location for this Output has been normalized.

    • normalizedPath

      scala.Option<String> normalizedPath()
      Normalized storage location used for storing materializations for this Output. If None, it means this Output has not been normalized yet.
      Returns:
      (undocumented)

    • path

      String path() throws SparkException
      Return the normalized storage location for this Output and throw if the storage location has not been normalized.
      Returns:
      (undocumented)
      Throws:
      SparkException