pyspark.sql.functions.kll_sketch_merge_float#

pyspark.sql.functions.kll_sketch_merge_float(left, right)[source]#

Merges two KLL float sketch buffers together into one.

New in version 4.1.0.

Parameters

leftColumn or column name: The first KLL float sketch
rightColumn or column name: The second KLL float sketch

Returns

Column: The merged KLL sketch.

Examples

>>> from pyspark.sql import functions as sf
>>> df = spark.createDataFrame([1.0,2.0,3.0,4.0,5.0], "FLOAT")
>>> sketch_df = df.agg(sf.kll_sketch_agg_float("value").alias("sketch"))
>>> result = sketch_df.select(sf.kll_sketch_merge_float("sketch", "sketch")).first()[0]
>>> result is not None and len(result) > 0
True