public abstract class UnaryTransformer<IN,OUT,T extends UnaryTransformer<IN,OUT,T>> extends Transformer implements HasInputCol, HasOutputCol, Logging
Constructor and Description |
---|
UnaryTransformer() |
Modifier and Type | Method and Description |
---|---|
T |
setInputCol(String value) |
T |
setOutputCol(String value) |
SchemaRDD |
transform(SchemaRDD dataset,
ParamMap paramMap)
Transforms the dataset with provided parameter map as additional parameters.
|
org.apache.spark.sql.catalyst.types.StructType |
transformSchema(org.apache.spark.sql.catalyst.types.StructType schema,
ParamMap paramMap)
Derives the output schema from the input schema and parameters.
|
transform, transform, transform, transform, transform
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getInputCol, inputCol
getOutputCol, outputCol
explainParams, get, getParam, isSet, paramMap, params, set, validate, validate
uid
initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning
public T setInputCol(String value)
public T setOutputCol(String value)
public org.apache.spark.sql.catalyst.types.StructType transformSchema(org.apache.spark.sql.catalyst.types.StructType schema, ParamMap paramMap)
PipelineStage
transformSchema
in class PipelineStage
public SchemaRDD transform(SchemaRDD dataset, ParamMap paramMap)
Transformer
transform
in class Transformer
dataset
- input datasetparamMap
- additional parameters, overwrite embedded params