public interface ExternalClusterManager
Modifier and Type | Method and Description |
---|---|
boolean |
canCreate(String masterURL)
Check if this cluster manager instance can create scheduler components
for a certain master URL.
|
SchedulerBackend |
createSchedulerBackend(SparkContext sc,
String masterURL,
TaskScheduler scheduler)
Create a scheduler backend for the given SparkContext and scheduler.
|
TaskScheduler |
createTaskScheduler(SparkContext sc,
String masterURL)
Create a task scheduler instance for the given SparkContext
|
void |
initialize(TaskScheduler scheduler,
SchedulerBackend backend)
Initialize task scheduler and backend scheduler.
|
boolean canCreate(String masterURL)
masterURL
- the master URLSchedulerBackend createSchedulerBackend(SparkContext sc, String masterURL, TaskScheduler scheduler)
ExternalClusterManager.createTaskScheduler()
.sc
- SparkContextmasterURL
- the master URLscheduler
- TaskScheduler that will be used with the scheduler backend.TaskScheduler createTaskScheduler(SparkContext sc, String masterURL)
sc
- SparkContextmasterURL
- the master URLvoid initialize(TaskScheduler scheduler, SchedulerBackend backend)
scheduler
- TaskScheduler that will be responsible for task handlingbackend
- SchedulerBackend that works with a TaskScheduler