Package org.apache.spark.shuffle.api
Interface SingleSpillShuffleMapOutputWriter
@Private
public interface SingleSpillShuffleMapOutputWriter
Optional extension for partition writing that is optimized for transferring a single
file to the backing store.
-
Method Summary
Modifier and TypeMethodDescriptionvoid
transferMapSpillFile
(File mapOutputFile, long[] partitionLengths, long[] checksums) Transfer a file that contains the bytes of all the partitions written by this map task.
-
Method Details
-
transferMapSpillFile
void transferMapSpillFile(File mapOutputFile, long[] partitionLengths, long[] checksums) throws IOException Transfer a file that contains the bytes of all the partitions written by this map task.- Throws:
IOException
-