org.apache.spark.sql.pipelines.graph
SqlGraphRegistrationContext
Companion class SqlGraphRegistrationContext
object SqlGraphRegistrationContext
- Alphabetic
- By Inheritance
- SqlGraphRegistrationContext
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Type Members
- case class SqlQueryPlanWithOrigin(plan: LogicalPlan, queryOrigin: QueryOrigin) extends Product with Serializable
Class that holds the logical plan and query origin parsed from a SQL statement.
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- def splitSqlFileIntoQueries(spark: SparkSession, sqlFileText: String, sqlFilePath: String): Seq[SqlQueryPlanWithOrigin]
Given a SQL file (raw text content and path), return the parsed logical plan and query origin per SQL statement in the file contents.
Given a SQL file (raw text content and path), return the parsed logical plan and query origin per SQL statement in the file contents.
Note that the returned origins will not be complete - origin information like object name and type will only be determined and populate when the logical plan is inspected during SQL element registration.
- spark
the spark session to use to parse SQL statements.
- sqlFileText
the raw text content of the SQL file.
- sqlFilePath
the file path to the SQL file. Only used to populate the query origin.
- returns
a SqlQueryPlanWithOrigin object per SQL statement, in the same order the SQL statements were defined in the file contents.
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)