Package org.apache.spark.launcher
Class InProcessLauncher
Object
org.apache.spark.launcher.AbstractLauncher<InProcessLauncher>
org.apache.spark.launcher.InProcessLauncher
In-process launcher for Spark applications.
Use this class to start Spark applications programmatically. Applications launched using this class will run in the same process as the caller.
Because Spark only supports a single active instance of SparkContext
per JVM, code
that uses this class should be careful about which applications are launched. It's recommended
that this launcher only be used to launch applications in cluster mode.
Also note that, when running applications in client mode, JVM-related configurations (like driver memory or configs which modify the driver's class path) do not take effect. Logging configuration is also inherited from the parent application.
- Since:
- 2.3.0
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionstartApplication
(SparkAppHandle.Listener... listeners) Starts a Spark application.Methods inherited from class org.apache.spark.launcher.AbstractLauncher
addAppArgs, addFile, addJar, addPyFile, addSparkArg, addSparkArg, setAppName, setAppResource, setConf, setDeployMode, setMainClass, setMaster, setPropertiesFile, setRemote, setVerbose
-
Constructor Details
-
InProcessLauncher
public InProcessLauncher()
-
-
Method Details
-
startApplication
Starts a Spark application.- Specified by:
startApplication
in classAbstractLauncher<InProcessLauncher>
- Parameters:
listeners
- Listeners to add to the handle before the app is launched.- Returns:
- A handle for the launched application.
- Throws:
IOException
- See Also:
-