Package org.apache.spark.sql.pipelines.logging
package org.apache.spark.sql.pipelines.logging
-
ClassDescriptionA factory object that is used to construct
PipelineEvents with common fields automatically filled in.Contains helpers and implicits for working withPipelineEvents.This class should be used for all flow progress events logging, it controls the level at which events are logged.An internal event that is emitted during the run of a pipeline.Describes where the event originated from param: datasetName The name of the dataset param: flowName The name of the flow param: sourceCodeLocation The location of the source codeAn in-memory buffer which contains the internal events that are emitted during a run of a pipeline.A streaming listener that converts streaming events into pipeline events for the relevant flows.