Package org.apache.spark.storage.memory

Interface BlockEvictionHandler

public interface BlockEvictionHandler

  • Method Summary

    Modifier and Type
    Method
    Description
    <T> StorageLevel
    dropFromMemory(BlockId blockId, scala.Function0<scala.util.Either<Object,org.apache.spark.util.io.ChunkedByteBuffer>> data, scala.reflect.ClassTag<T> evidence$1)
    Drop a block from memory, possibly putting it on disk if applicable.

  • Method Details

    • dropFromMemory

      <T> StorageLevel dropFromMemory(BlockId blockId, scala.Function0<scala.util.Either<Object,org.apache.spark.util.io.ChunkedByteBuffer>> data, scala.reflect.ClassTag<T> evidence$1)
      Drop a block from memory, possibly putting it on disk if applicable. Called when the memory store reaches its limit and needs to free up space.

      If data is not put on disk, it won't be created.

      The caller of this method must hold a write lock on the block before calling this method. This method does not release the write lock.

      Parameters:
      blockId - (undocumented)
      data - (undocumented)
      evidence$1 - (undocumented)
      Returns:
      the block's new effective StorageLevel.