public abstract class PipelineStage extends java.lang.Object implements Params, Logging
Estimator
or a Transformer
.Constructor and Description |
---|
PipelineStage() |
Modifier and Type | Method and Description |
---|---|
abstract PipelineStage |
copy(ParamMap extra)
Creates a copy of this instance with the same UID and some extra params.
|
abstract StructType |
transformSchema(StructType schema)
:: DeveloperApi ::
|
protected StructType |
transformSchema(StructType schema,
boolean logging)
:: DeveloperApi ::
|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
clear, copyValues, defaultCopy, defaultParamMap, explainParam, explainParams, extractParamMap, extractParamMap, get, getDefault, getOrDefault, getParam, hasDefault, hasParam, isDefined, isSet, paramMap, params, set, set, set, setDefault, setDefault, shouldOwn, validateParams
toString, uid
initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning
public abstract StructType transformSchema(StructType schema)
Derives the output schema from the input schema.
schema
- (undocumented)protected StructType transformSchema(StructType schema, boolean logging)
Derives the output schema from the input schema and parameters, optionally with logging.
This should be optimistic. If it is unclear whether the schema will be valid, then it should be assumed valid until proven otherwise.
schema
- (undocumented)logging
- (undocumented)public abstract PipelineStage copy(ParamMap extra)
Params