public static class Pipeline.SharedReadWrite$
extends Object
Modifier and Type | Field and Description |
---|---|
static Pipeline.SharedReadWrite$ |
MODULE$
Static reference to the singleton instance of this Scala object.
|
Constructor and Description |
---|
SharedReadWrite$() |
Modifier and Type | Method and Description |
---|---|
String |
getStagePath(String stageUid,
int stageIdx,
int numStages,
String stagesDir)
Get path for saving the given stage.
|
scala.Tuple2<String,PipelineStage[]> |
load(String expectedClassName,
SparkContext sc,
String path)
Load metadata and stages for a
Pipeline or PipelineModel |
void |
saveImpl(Params instance,
PipelineStage[] stages,
SparkContext sc,
String path)
Save metadata and stages for a
Pipeline or PipelineModel
- save metadata to path/metadata
- save stages to stages/IDX_UID |
void |
validateStages(PipelineStage[] stages)
Check that all stages are Writable
|
public static final Pipeline.SharedReadWrite$ MODULE$
public void validateStages(PipelineStage[] stages)
public void saveImpl(Params instance, PipelineStage[] stages, SparkContext sc, String path)
Pipeline
or PipelineModel
- save metadata to path/metadata
- save stages to stages/IDX_UIDinstance
- (undocumented)stages
- (undocumented)sc
- (undocumented)path
- (undocumented)public scala.Tuple2<String,PipelineStage[]> load(String expectedClassName, SparkContext sc, String path)
Pipeline
or PipelineModel
expectedClassName
- (undocumented)sc
- (undocumented)path
- (undocumented)public String getStagePath(String stageUid, int stageIdx, int numStages, String stagesDir)