Type Members

1.  trait AggregateFunc extends Expression with Serializable

   Base class of the Aggregate Functions.

   Base class of the Aggregate Functions.

   Annotations

   @Evolving()

   Since

   3.2.0

2.  final class Aggregation extends Record with Serializable

   Aggregation in SQL statement.

   Aggregation in SQL statement.

   Annotations

   @Evolving()

   Since

   3.2.0

3.  final class Avg extends ExpressionWithToString with AggregateFunc

   An aggregate function that returns the mean of all the values in a group.

   An aggregate function that returns the mean of all the values in a group.

   Annotations

   @Evolving()

   Since

   3.3.0

4.  final class Count extends ExpressionWithToString with AggregateFunc

   An aggregate function that returns the number of the specific row in a group.

   An aggregate function that returns the number of the specific row in a group.

   Annotations

   @Evolving()

   Since

   3.2.0

5.  final class CountStar extends ExpressionWithToString with AggregateFunc

   An aggregate function that returns the number of rows in a group.

   An aggregate function that returns the number of rows in a group.

   Annotations

   @Evolving()

   Since

   3.2.0

6.  final class GeneralAggregateFunc extends ExpressionWithToString with AggregateFunc

   The general implementation of AggregateFunc, which contains the upper-cased function name, the isDistinct flag and all the inputs.

   The general implementation of AggregateFunc, which contains the upper-cased function name, the isDistinct flag and all the inputs. Note that Spark cannot push down partial aggregate with this function to the source, but can only push down the entire aggregate.

   The currently supported SQL aggregate functions:

   • VAR_POP(input1)
     

     Since 3.3.0

   • VAR_SAMP(input1)
     

     Since 3.3.0

   • STDDEV_POP(input1)
     

     Since 3.3.0

   • STDDEV_SAMP(input1)
     

     Since 3.3.0

   • COVAR_POP(input1, input2)
     

     Since 3.3.0

   • COVAR_SAMP(input1, input2)
     

     Since 3.3.0

   • CORR(input1, input2)
     

     Since 3.3.0

   • REGR_INTERCEPT(input1, input2)
     

     Since 3.4.0

   • REGR_R2(input1, input2)
     

     Since 3.4.0

   • REGR_SLOPE(input1, input2)
     

     Since 3.4.0

   • REGR_SXY(input1, input2)
     

     Since 3.4.0

   • MODE() WITHIN (ORDER BY input1 [ASC|DESC])
     

     Since 4.0.0

   • PERCENTILE_CONT(input1) WITHIN (ORDER BY input2 [ASC|DESC])
     

     Since 4.0.0

   • PERCENTILE_DISC(input1) WITHIN (ORDER BY input2 [ASC|DESC])
     

     Since 4.0.0

   Annotations

   @Evolving()

   Since

   3.3.0

7.  final class Max extends ExpressionWithToString with AggregateFunc

   An aggregate function that returns the maximum value in a group.

   An aggregate function that returns the maximum value in a group.

   Annotations

   @Evolving()

   Since

   3.2.0

8.  final class Min extends ExpressionWithToString with AggregateFunc

   An aggregate function that returns the minimum value in a group.

   An aggregate function that returns the minimum value in a group.

   Annotations

   @Evolving()

   Since

   3.2.0

9.  final class Sum extends ExpressionWithToString with AggregateFunc

   An aggregate function that returns the summation of all the values in a group.

   An aggregate function that returns the summation of all the values in a group.

   Annotations

   @Evolving()

   Since

   3.2.0

10.  class UserDefinedAggregateFunc extends ExpressionWithToString with AggregateFunc

    The general representation of user defined aggregate function, which implements AggregateFunc, contains the upper-cased function name, the canonical function name, the isDistinct flag and all the inputs.

    The general representation of user defined aggregate function, which implements AggregateFunc, contains the upper-cased function name, the canonical function name, the isDistinct flag and all the inputs. Note that Spark cannot push down aggregate with this function partially to the source, but can only push down the entire aggregate.

    Annotations

    @Evolving()

    Since

    3.4.0