Type Members

1.  trait DriverPlugin extends AnyRef

   :: DeveloperApi :: Driver component of a SparkPlugin.

   :: DeveloperApi :: Driver component of a SparkPlugin.

   Annotations

   @DeveloperApi()

   Since

   3.0.0

2.  trait ExecutorPlugin extends AnyRef

   :: DeveloperApi :: Executor component of a SparkPlugin.

   :: DeveloperApi :: Executor component of a SparkPlugin.

   Annotations

   @DeveloperApi()

   Since

   3.0.0

3.  trait PluginContext extends AnyRef

   :: DeveloperApi :: Context information and operations for plugins loaded by Spark.

   :: DeveloperApi :: Context information and operations for plugins loaded by Spark.

   An instance of this class is provided to plugins in their initialization method. It is safe for plugins to keep a reference to the instance for later use (for example, to send messages to the plugin's driver component).

   Context instances are plugin-specific, so metrics and messages are tied each plugin. It is not possible for a plugin to directly interact with other plugins.

   Annotations

   @DeveloperApi()

   Since

   3.0.0

4.  trait SparkPlugin extends AnyRef

   :: DeveloperApi :: A plugin that can be dynamically loaded into a Spark application.

   :: DeveloperApi :: A plugin that can be dynamically loaded into a Spark application.

   Plugins can be loaded by adding the plugin's class name to the appropriate Spark configuration. Check the Spark monitoring guide for details.

   Plugins have two optional components: a driver-side component, of which a single instance is created per application, inside the Spark driver. And an executor-side component, of which one instance is created in each executor that is started by Spark. Details of each component can be found in the documentation for DriverPlugin and ExecutorPlugin.

   Annotations

   @DeveloperApi()

   Since

   3.0.0