spark.storage

StorageLevel

class StorageLevel extends Externalizable

Flags for controlling the storage of an RDD. Each StorageLevel records whether to use memory, whether to drop the RDD to disk if it falls out of memory, whether to keep the data in memory in a serialized format, and whether to replicate the RDD partitions on multiple nodes. The spark.storage.StorageLevel$ singleton object contains some static constants for commonly useful storage levels.

Linear Supertypes
Externalizable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Hide All
  2. Show all
  1. StorageLevel
  2. Externalizable
  3. Serializable
  4. AnyRef
  5. Any
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StorageLevel()

  2. new StorageLevel(flags: Int, replication: Int)

  3. new StorageLevel(useDisk: Boolean, useMemory: Boolean, deserialized: Boolean, replication: Int = 1)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): StorageLevel

    Definition Classes
    StorageLevel → AnyRef
  8. var deserialized: Boolean

  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  10. def equals(other: Any): Boolean

    Definition Classes
    StorageLevel → AnyRef → Any
  11. def finalize(): Unit

    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws()
  12. final def getClass(): java.lang.Class[_]

    Definition Classes
    AnyRef → Any
  13. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  14. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  15. def isValid: Boolean

  16. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  17. final def notify(): Unit

    Definition Classes
    AnyRef
  18. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  19. def readExternal(in: ObjectInput): Unit

    Definition Classes
    StorageLevel → Externalizable
  20. var replication: Int

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  22. def toInt: Int

  23. def toString(): String

    Definition Classes
    StorageLevel → AnyRef → Any
  24. var useDisk: Boolean

  25. var useMemory: Boolean

  26. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws()
  27. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws()
  28. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws()
  29. def writeExternal(out: ObjectOutput): Unit

    Definition Classes
    StorageLevel → Externalizable

Inherited from Externalizable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any