Package org.apache.spark.ml.feature

Class Word2VecModel.Word2VecModelWriter$

Object

org.apache.spark.ml.feature.Word2VecModel.Word2VecModelWriter$

Enclosing class:

Word2VecModel

public static class Word2VecModel.Word2VecModelWriter$
extends Object

Field Summary

Fields

Modifier and Type	Field	Description
static final Word2VecModel.Word2VecModelWriter$	MODULE$	Static reference to the singleton instance of this Scala object.

Constructor Summary

Constructors

Constructor	Description
Word2VecModelWriter$()

Method Summary

Modifier and Type	Method	Description
int	calculateNumberOfPartitions(long bufferSizeInBytes, int numWords, int vectorSize)	Calculate the number of partitions to use in saving the model.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

MODULE$

public static final Word2VecModel.Word2VecModelWriter$ MODULE$

Static reference to the singleton instance of this Scala object.

Constructor Details

Word2VecModelWriter$

public Word2VecModelWriter$()

Method Details

calculateNumberOfPartitions

public int calculateNumberOfPartitions(long bufferSizeInBytes,
 int numWords,
 int vectorSize)

Calculate the number of partitions to use in saving the model. [SPARK-11994] - We want to partition the model in partitions smaller than spark.kryoserializer.buffer.max

Parameters:

bufferSizeInBytes - Set to spark.kryoserializer.buffer.max

numWords - Vocab size

vectorSize - Vector length for each word

Returns:

(undocumented)