class ResourceProfileBuilder extends AnyRef
Resource profile builder to build a ResourceProfile to associate with an RDD. A ResourceProfile allows the user to specify executor and task resource requirements for an RDD that will get applied during a stage. This allows the user to change the resource requirements between stages.
- Annotations
- @Evolving() @Since( "3.1.0" )
- Source
- ResourceProfileBuilder.scala
- Alphabetic
- By Inheritance
- ResourceProfileBuilder
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new ResourceProfileBuilder()
Value Members
- def build(): ResourceProfile
- def clearExecutorResourceRequests(): ResourceProfileBuilder.this.type
- def clearTaskResourceRequests(): ResourceProfileBuilder.this.type
- def executorResources: Map[String, ExecutorResourceRequest]
-
def
executorResourcesJMap: Map[String, ExecutorResourceRequest]
(Java-specific) gets a Java Map of resources to ExecutorResourceRequest
-
def
require(requests: TaskResourceRequests): ResourceProfileBuilder.this.type
Add task resource requests
Add task resource requests
- requests
The detailed task resource requests, see TaskResourceRequest
- returns
This ResourceProfileBuilder
-
def
require(requests: ExecutorResourceRequests): ResourceProfileBuilder.this.type
Add executor resource requests
Add executor resource requests
- requests
The detailed executor resource requests, see ExecutorResourceRequests
- returns
This ResourceProfileBuilder
- def taskResources: Map[String, TaskResourceRequest]
-
def
taskResourcesJMap: Map[String, TaskResourceRequest]
(Java-specific) gets a Java Map of resources to TaskResourceRequest
-
def
toString(): String
- Definition Classes
- ResourceProfileBuilder → AnyRef → Any