Binarize a column of continuous features given a threshold.
Bucketizer maps a column of continuous features to a column of feature buckets.
Chi-Squared feature selection, which selects categorical features to use for predicting a categorical label.
Model fitted by ChiSqSelector.
Extracts a vocabulary from document collections and generates a CountVectorizerModel.
Converts a text document to a sparse vector of token counts.
A feature transformer that takes the 1D discrete cosine transform of a real vector.
Outputs the Hadamard product (i.e., the element-wise product) of each input vector with a provided "weight" vector.
Maps a sequence of terms to their term frequencies using the hashing trick.
Compute the Inverse Document Frequency (IDF) given a collection of documents.
Model fitted by IDF.
A Transformer that maps a column of indices back to a new column of corresponding string values.
StringIndexer for converting strings into indices
Implements the feature interaction transform.
:: Experimental ::
Label for this data point.
List of features for this data point.
:: Experimental :: Rescale each feature individually to range [-1, 1] by dividing through the largest maximum absolute value in each feature.
:: Experimental :: Model fitted by MaxAbsScaler.
Rescale each feature individually to a common range [min, max] linearly using column summary statistics, which is also known as min-max normalization or Rescaling.
Model fitted by MinMaxScaler.
A feature transformer that converts the input array of strings into an array of n-grams.
Normalize a vector to have unit norm using the given p-norm.
A one-hot encoder that maps a column of category indices to a column of binary vectors, with at most a single one-value per row that indicates the input category index.
StringIndexer for converting categorical values into category indices
PCA trains a model to project vectors to a lower dimensional space of the top PCA!.k principal components.
Model fitted by PCA.
Perform feature expansion in a polynomial space.
QuantileDiscretizer takes a column with continuous features and outputs a column with binned
:: Experimental :: Implements the transforms required for fitting a dataset against an R model formula.
:: Experimental :: Model fitted by RFormula.
A regex based tokenizer that extracts tokens either by using the provided regex pattern to split
the text (default) or repeatedly matching the regex (if
gaps is false).
Implements the transformations which are defined by SQL statement.
Standardizes features by removing the mean and scaling to unit variance using column summary statistics on the samples in the training set.
Model fitted by StandardScaler.
A feature transformer that filters out stop words from input.
A label indexer that maps a string column of labels to an ML column of label indices.
IndexToString for the inverse transformation
Model fitted by StringIndexer.
A tokenizer that converts the input string to lowercase and then splits it by white spaces.
A feature transformer that merges multiple columns into a vector column.
Class for indexing categorical feature columns in a dataset of Vector.
Model fitted by VectorIndexer.
This class takes a feature vector and outputs a new feature vector with a subarray of the original features.
Word2Vec trains a model of
Map(String, Vector), i.e.
Model fitted by Word2Vec.
The expansion is done via recursion.