org.apache.spark.resource

Class ResourceProfileBuilder

Object

org.apache.spark.resource.ResourceProfileBuilder

public class ResourceProfileBuilder
extends Object

Resource profile builder to build a ResourceProfile to associate with an RDD. A ResourceProfile allows the user to specify executor and task resource requirements for an RDD that will get applied during a stage. This allows the user to change the resource requirements between stages.

Constructor Summary

Constructors

Constructor and Description
ResourceProfileBuilder()

Method Summary

Modifier and Type	Method and Description
ResourceProfile	build()
ResourceProfileBuilder	clearExecutorResourceRequests()
ResourceProfileBuilder	clearTaskResourceRequests()
scala.collection.immutable.Map<String,ExecutorResourceRequest>	executorResources()
java.util.Map<String,ExecutorResourceRequest>	executorResourcesJMap() (Java-specific) gets a Java Map of resources to ExecutorResourceRequest
ResourceProfileBuilder	require(ExecutorResourceRequests requests) Add executor resource requests
ResourceProfileBuilder	require(TaskResourceRequests requests) Add task resource requests
scala.collection.immutable.Map<String,TaskResourceRequest>	taskResources()
java.util.Map<String,TaskResourceRequest>	taskResourcesJMap() (Java-specific) gets a Java Map of resources to TaskResourceRequest
String	toString()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ResourceProfileBuilder

public ResourceProfileBuilder()

Method Detail

build

public ResourceProfile build()

clearExecutorResourceRequests

public ResourceProfileBuilder clearExecutorResourceRequests()

clearTaskResourceRequests

public ResourceProfileBuilder clearTaskResourceRequests()

executorResources

public scala.collection.immutable.Map<String,ExecutorResourceRequest> executorResources()

executorResourcesJMap

public java.util.Map<String,ExecutorResourceRequest> executorResourcesJMap()

(Java-specific) gets a Java Map of resources to ExecutorResourceRequest

Returns:

(undocumented)

require

public ResourceProfileBuilder require(ExecutorResourceRequests requests)

Add executor resource requests

Parameters:

requests - The detailed executor resource requests, see ExecutorResourceRequests

Returns:

This ResourceProfileBuilder

require

public ResourceProfileBuilder require(TaskResourceRequests requests)

Add task resource requests

Parameters:

requests - The detailed task resource requests, see TaskResourceRequest

Returns:

This ResourceProfileBuilder

taskResources

public scala.collection.immutable.Map<String,TaskResourceRequest> taskResources()

taskResourcesJMap

public java.util.Map<String,TaskResourceRequest> taskResourcesJMap()

(Java-specific) gets a Java Map of resources to TaskResourceRequest

Returns:

(undocumented)

toString

public String toString()

Overrides:

toString in class Object