org.apache.spark.ml.feature

Class Word2VecModel.Word2VecModelWriter$

Object

org.apache.spark.ml.feature.Word2VecModel.Word2VecModelWriter$

Enclosing class:

Word2VecModel

public static class Word2VecModel.Word2VecModelWriter$
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
static Word2VecModel.Word2VecModelWriter$	MODULE$ Static reference to the singleton instance of this Scala object.

Constructor Summary

Constructors

Constructor and Description
Word2VecModelWriter$()

Method Summary

Modifier and Type	Method and Description
int	calculateNumberOfPartitions(long bufferSizeInBytes, int numWords, int vectorSize) Calculate the number of partitions to use in saving the model.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MODULE$

public static final Word2VecModel.Word2VecModelWriter$ MODULE$

Static reference to the singleton instance of this Scala object.

Constructor Detail

Word2VecModelWriter$

public Word2VecModelWriter$()

Method Detail

calculateNumberOfPartitions

public int calculateNumberOfPartitions(long bufferSizeInBytes,
                                       int numWords,
                                       int vectorSize)

Calculate the number of partitions to use in saving the model. [SPARK-11994] - We want to partition the model in partitions smaller than spark.kryoserializer.buffer.max

Parameters:

bufferSizeInBytes - Set to spark.kryoserializer.buffer.max

numWords - Vocab size

vectorSize - Vector length for each word

Returns:

(undocumented)