DataFrameNaFunctions

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

5. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

6. final def asInstanceOf[T0]: T0

   Definition Classes

   Any

7. def clone(): AnyRef

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

8. def drop(minNonNulls: Int, cols: Seq[String]): DataFrame

   (Scala-specific) Returns a new DataFrame that drops rows containing less than minNonNulls non-null values in the specified columns.

9. def drop(minNonNulls: Int, cols: Array[String]): DataFrame

   Returns a new DataFrame that drops rows containing less than minNonNulls non-null values in the specified columns.

10. def drop(minNonNulls: Int): DataFrame

    Returns a new DataFrame that drops rows containing less than minNonNulls non-null values.

11. def drop(how: String, cols: Seq[String]): DataFrame

    (Scala-specific) Returns a new DataFrame that drops rows containing null values in the specified columns.

    (Scala-specific) Returns a new DataFrame that drops rows containing null values in the specified columns.

    If how is "any", then drop rows containing any null values in the specified columns. If how is "all", then drop rows only if every specified column is null for that row.

12. def drop(how: String, cols: Array[String]): DataFrame

    Returns a new DataFrame that drops rows containing null values in the specified columns.

    Returns a new DataFrame that drops rows containing null values in the specified columns.

    If how is "any", then drop rows containing any null values in the specified columns. If how is "all", then drop rows only if every specified column is null for that row.

13. def drop(cols: Seq[String]): DataFrame

    (Scala-specific) Returns a new that drops rows containing any null values in the specified columns.

14. def drop(cols: Array[String]): DataFrame

    Returns a new DataFrame that drops rows containing any null values in the specified columns.

15. def drop(how: String): DataFrame

    Returns a new DataFrame that drops rows containing null values.

    Returns a new DataFrame that drops rows containing null values.

    If how is "any", then drop rows containing any null values. If how is "all", then drop rows only if every column is null for that row.

16. def drop(): DataFrame

    Returns a new DataFrame that drops rows containing any null values.

17. final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

18. def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

19. def fill(valueMap: Map[String, Any]): DataFrame

    (Scala-specific) Returns a new DataFrame that replaces null values.

    (Scala-specific) Returns a new DataFrame that replaces null values.

    The key of the map is the column name, and the value of the map is the replacement value. The value must be of the following type: Int, Long, Float, Double, String.

    For example, the following replaces null values in column "A" with string "unknown", and null values in column "B" with numeric value 1.0.

    df.na.fill(Map(
      "A" -> "unknown",
      "B" -> 1.0
    ))

20. def fill(valueMap: Map[String, Any]): DataFrame

    Returns a new DataFrame that replaces null values.

    Returns a new DataFrame that replaces null values.

    The key of the map is the column name, and the value of the map is the replacement value. The value must be of the following type: Integer, Long, Float, Double, String.

    For example, the following replaces null values in column "A" with string "unknown", and null values in column "B" with numeric value 1.0.

    import com.google.common.collect.ImmutableMap;
    df.na.fill(ImmutableMap.of("A", "unknown", "B", 1.0));

21. def fill(value: String, cols: Seq[String]): DataFrame

    (Scala-specific) Returns a new DataFrame that replaces null values in specified string columns.

    (Scala-specific) Returns a new DataFrame that replaces null values in specified string columns. If a specified column is not a string column, it is ignored.

22. def fill(value: String, cols: Array[String]): DataFrame

    Returns a new DataFrame that replaces null values in specified string columns.

    Returns a new DataFrame that replaces null values in specified string columns. If a specified column is not a string column, it is ignored.

23. def fill(value: Double, cols: Seq[String]): DataFrame

    (Scala-specific) Returns a new DataFrame that replaces null values in specified numeric columns.

    (Scala-specific) Returns a new DataFrame that replaces null values in specified numeric columns. If a specified column is not a numeric column, it is ignored.

24. def fill(value: Double, cols: Array[String]): DataFrame

    Returns a new DataFrame that replaces null values in specified numeric columns.

    Returns a new DataFrame that replaces null values in specified numeric columns. If a specified column is not a numeric column, it is ignored.

25. def fill(value: String): DataFrame

    Returns a new that replaces null values in string columns with value.

26. def fill(value: Double): DataFrame

    Returns a new DataFrame that replaces null values in numeric columns with value.

27. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

28. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

29. def hashCode(): Int

    Definition Classes

    AnyRef → Any

30. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

31. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

32. final def notify(): Unit

    Definition Classes

    AnyRef

33. final def notifyAll(): Unit

    Definition Classes

    AnyRef

34. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

35. def toString(): String

    Definition Classes

    AnyRef → Any

36. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

37. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

38. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )