public abstract class PipelineStage extends Object implements scala.Serializable, Logging
Estimator
or a Transformer
.Constructor and Description |
---|
PipelineStage() |
Modifier and Type | Method and Description |
---|---|
abstract org.apache.spark.sql.types.StructType |
transformSchema(org.apache.spark.sql.types.StructType schema,
ParamMap paramMap)
:: DeveloperAPI ::
|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning
public abstract org.apache.spark.sql.types.StructType transformSchema(org.apache.spark.sql.types.StructType schema, ParamMap paramMap)
Derives the output schema from the input schema and parameters. The schema describes the columns and types of the data.
schema
- Input schema to this stageparamMap
- Parameters passed to this stage