Package org.apache.spark.io
package org.apache.spark.io
IO codecs used for compression.
-
ClassDescriptionDeveloper API CompressionCodec allows the customization of choosing different compression implementations to be used in block storage.Developer API LZ4 implementation of
CompressionCodec
.Developer API LZF implementation ofCompressionCodec
.InputStream
implementation which uses direct buffer to read a file to avoid extra copy of data between Java and native memory which happens when usingBufferedInputStream
.InputStream
implementation which asynchronously reads ahead from the underlying input stream when specified amount of data has been read from the current buffer.Developer API Snappy implementation ofCompressionCodec
.Developer API ZStandard implementation ofCompressionCodec
.