class ResourceProfile extends Serializable with Logging
Resource profile to associate with an RDD. A ResourceProfile allows the user to specify executor and task requirements for an RDD that will get applied during a stage. This allows the user to change the resource requirements between stages. This is meant to be immutable so user can't change it after building. Users should use ResourceProfileBuilder to build it.
- Annotations
- @Evolving() @Since( "3.1.0" )
- Source
- ResourceProfile.scala
- Alphabetic
- By Inheritance
- ResourceProfile
- Logging
- Serializable
- Serializable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
ResourceProfile(executorResources: Map[String, ExecutorResourceRequest], taskResources: Map[String, TaskResourceRequest])
- executorResources
Resource requests for executors. Mapped from the resource name (e.g., cores, memory, CPU) to its specific request.
- taskResources
Resource requests for tasks. Mapped from the resource name (e.g., cores, memory, CPU) to its specific request.
Value Members
-
def
equals(obj: Any): Boolean
- Definition Classes
- ResourceProfile → AnyRef → Any
- val executorResources: Map[String, ExecutorResourceRequest]
-
def
executorResourcesJMap: Map[String, ExecutorResourceRequest]
(Java-specific) gets a Java Map of resources to ExecutorResourceRequest
-
def
hashCode(): Int
- Definition Classes
- ResourceProfile → AnyRef → Any
-
def
id: Int
A unique id of this ResourceProfile
- val taskResources: Map[String, TaskResourceRequest]
-
def
taskResourcesJMap: Map[String, TaskResourceRequest]
(Java-specific) gets a Java Map of resources to TaskResourceRequest
-
def
toString(): String
- Definition Classes
- ResourceProfile → AnyRef → Any