Packages

  • package root
    Definition Classes
    root
  • package org
    Definition Classes
    root
  • package apache
    Definition Classes
    org
  • package spark

    Core Spark functionality.

    Core Spark functionality. org.apache.spark.SparkContext serves as the main entry point to Spark, while org.apache.spark.rdd.RDD is the data type representing a distributed collection, and provides most parallel operations.

    In addition, org.apache.spark.rdd.PairRDDFunctions contains operations available only on RDDs of key-value pairs, such as groupByKey and join; org.apache.spark.rdd.DoubleRDDFunctions contains operations available only on RDDs of Doubles; and org.apache.spark.rdd.SequenceFileRDDFunctions contains operations available on RDDs that can be saved as SequenceFiles. These operations are automatically available on any RDD of the right type (e.g. RDD[(Int, Int)] through implicit conversions.

    Java programmers should reference the org.apache.spark.api.java package for Spark programming APIs in Java.

    Classes and methods marked with Experimental are user-facing features which have not been officially adopted by the Spark project. These are subject to change or removal in minor releases.

    Classes and methods marked with Developer API are intended for advanced users want to extend Spark through lower level interfaces. These are subject to changes or removal in minor releases.

    Definition Classes
    apache
  • package sql

    Allows the execution of relational queries, including those expressed in SQL using Spark.

    Allows the execution of relational queries, including those expressed in SQL using Spark.

    Definition Classes
    spark
  • package connector
    Definition Classes
    sql
  • package util
    Definition Classes
    connector
  • V2ExpressionSQLBuilder
c

org.apache.spark.sql.connector.util

V2ExpressionSQLBuilder

class V2ExpressionSQLBuilder extends AnyRef

The builder to generate SQL from V2 expressions.

Source
V2ExpressionSQLBuilder.java
Since

3.3.0

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. V2ExpressionSQLBuilder
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new V2ExpressionSQLBuilder()

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def build(expr: Expression): String
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  9. def escapeSpecialCharsForLikePattern(str: String): String

    Escape the LIKE pattern special chars, using as the escape character.

    Escape the LIKE pattern special chars, using as the escape character. The LIKE patterns produced by #visitStartsWith, #visitEndsWith and #visitContains declare ESCAPE '', so the wildcards _ and % and the escape character itself must each be prefixed with to be matched literally.

    Note: This method adopts the escape representation within Spark and is not bound to any JDBC dialect. A JDBC dialect should overwrite this API if the underlying database has more LIKE special chars than _, % and . Escaping that is instead needed because the database treats a character specially inside a SQL string literal belongs in #escapeStringLiteralForLikePattern.

    Attributes
    protected[util]
  10. def escapeStringLiteralForLikePattern(str: String): String

    Escape the characters that the target database treats specially inside a SQL string literal, applied to a LIKE pattern (and its ESCAPE character) when embedding it into a '...' literal for predicate pushdown.

    Escape the characters that the target database treats specially inside a SQL string literal, applied to a LIKE pattern (and its ESCAPE character) when embedding it into a '...' literal for predicate pushdown.

    The default returns the input unchanged: a standard SQL string literal is taken verbatim (the single-quote doubling is already applied when the literal is rendered), so the that #escapeSpecialCharsForLikePattern uses as the LIKE escape character reaches the LIKE engine intact. A dialect whose string-literal syntax gives a special meaning (e.g. MySQL, which treats as an escape character inside string literals) must override this to double the backslash, so the LIKE pattern survives string-literal parsing unchanged.

    Attributes
    protected[util]
  11. def expressionsToStringArray(expressions: Array[Expression]): Array[String]
    Attributes
    protected[util]
  12. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  13. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  14. def inputToSQL(input: Expression): String
    Attributes
    protected[util]
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  17. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  18. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  19. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  20. def toString(): String
    Definition Classes
    AnyRef → Any
  21. def visitAggregateFunction(funcName: String, isDistinct: Boolean, inputs: Array[String]): String
    Attributes
    protected[util]
  22. def visitAggregateFunction(funcName: String, isDistinct: Boolean, inputs: Array[Expression]): String

    Builds SQL for an aggregate function.

    Builds SQL for an aggregate function.

    In V2ExpressionSQLBuilder, always use this override (with Expression[]) instead of the String[] version, as the String[] version does not validate whether the function is supported in JDBC dialects.

    Attributes
    protected[util]
  23. def visitAnd(name: String, l: String, r: String): String
    Attributes
    protected[util]
  24. def visitBinaryArithmetic(name: String, l: String, r: String): String
    Attributes
    protected[util]
  25. def visitBinaryComparison(name: String, l: String, r: String): String
    Attributes
    protected[util]
  26. def visitBinaryComparison(name: String, le: Expression, re: Expression): String
    Attributes
    protected[util]
  27. def visitCaseWhen(children: Array[String]): String
    Attributes
    protected[util]
  28. def visitCast(expr: String, exprDataType: DataType, targetDataType: DataType): String
    Attributes
    protected[util]
  29. def visitContains(l: String, r: String): String
    Attributes
    protected[util]
  30. def visitEndsWith(l: String, r: String): String
    Attributes
    protected[util]
  31. def visitExtract(field: String, source: String): String
    Attributes
    protected[util]
  32. def visitExtract(extract: Extract): String
    Attributes
    protected[util]
  33. def visitGetArrayItem(getArrayItem: GetArrayItem): String
    Attributes
    protected[util]
  34. def visitIn(v: String, list: List[String]): String
    Attributes
    protected[util]
  35. def visitInverseDistributionFunction(funcName: String, isDistinct: Boolean, inputs: Array[String], orderingWithinGroups: Array[String]): String
    Attributes
    protected[util]
  36. def visitIsNotNull(v: String): String
    Attributes
    protected[util]
  37. def visitIsNull(v: String): String
    Attributes
    protected[util]
  38. def visitLiteral(literal: Literal[_ <: AnyRef]): String
    Attributes
    protected[util]
  39. def visitNamedReference(namedRef: NamedReference): String
    Attributes
    protected[util]
  40. def visitNot(v: String): String
    Attributes
    protected[util]
  41. def visitOr(name: String, l: String, r: String): String
    Attributes
    protected[util]
  42. def visitOverlay(inputs: Array[String]): String
    Attributes
    protected[util]
  43. def visitPartitionPredicate(partitionPredicate: PartitionPredicate): String
    Attributes
    protected[util]
  44. def visitSQLFunction(funcName: String, inputs: Array[String]): String
    Attributes
    protected[util]
  45. def visitSQLFunction(funcName: String, inputs: Array[Expression]): String
    Attributes
    protected[util]
  46. def visitSortOrder(sortKey: String, sortDirection: SortDirection, nullOrdering: NullOrdering): String
    Attributes
    protected[util]
  47. def visitStartsWith(l: String, r: String): String
    Attributes
    protected[util]
  48. def visitTrim(direction: String, inputs: Array[String]): String
    Attributes
    protected[util]
  49. def visitUnaryArithmetic(name: String, v: String): String
    Attributes
    protected[util]
  50. def visitUnexpectedExpr(expr: Expression): String
    Attributes
    protected[util]
  51. def visitUserDefinedAggregateFunction(funcName: String, canonicalName: String, isDistinct: Boolean, inputs: Array[String]): String
    Attributes
    protected[util]
  52. def visitUserDefinedScalarFunction(funcName: String, canonicalName: String, inputs: Array[String]): String
    Attributes
    protected[util]
  53. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  54. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  55. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from AnyRef

Inherited from Any

Ungrouped