org.apache.spark.shuffle.api

Interface SingleSpillShuffleMapOutputWriter

@Private
public interface SingleSpillShuffleMapOutputWriter

Optional extension for partition writing that is optimized for transferring a single file to the backing store.

Method Summary

Modifier and Type	Method and Description
void	transferMapSpillFile(java.io.File mapOutputFile, long[] partitionLengths, long[] checksums) Transfer a file that contains the bytes of all the partitions written by this map task.

Method Detail

transferMapSpillFile

void transferMapSpillFile(java.io.File mapOutputFile,
                          long[] partitionLengths,
                          long[] checksums)
                   throws java.io.IOException

Transfer a file that contains the bytes of all the partitions written by this map task.

Throws:

java.io.IOException