Packages

class ResourceProfile extends Serializable with Logging

Resource profile to associate with an RDD. A ResourceProfile allows the user to specify executor and task requirements for an RDD that will get applied during a stage. This allows the user to change the resource requirements between stages. This is meant to be immutable so user can't change it after building. Users should use ResourceProfileBuilder to build it.

Annotations
@Evolving() @Since( "3.1.0" )
Source
ResourceProfile.scala
Linear Supertypes
Logging, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ResourceProfile
  2. Logging
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ResourceProfile(executorResources: Map[String, ExecutorResourceRequest], taskResources: Map[String, TaskResourceRequest])

    executorResources

    Resource requests for executors. Mapped from the resource name (e.g., cores, memory, CPU) to its specific request.

    taskResources

    Resource requests for tasks. Mapped from the resource name (e.g., cores, memory, CPU) to its specific request.

Value Members

  1. def equals(obj: Any): Boolean
    Definition Classes
    ResourceProfile → AnyRef → Any
  2. val executorResources: Map[String, ExecutorResourceRequest]
  3. def executorResourcesJMap: Map[String, ExecutorResourceRequest]

    (Java-specific) gets a Java Map of resources to ExecutorResourceRequest

  4. def hashCode(): Int
    Definition Classes
    ResourceProfile → AnyRef → Any
  5. def id: Int

    A unique id of this ResourceProfile

  6. val taskResources: Map[String, TaskResourceRequest]
  7. def taskResourcesJMap: Map[String, TaskResourceRequest]

    (Java-specific) gets a Java Map of resources to TaskResourceRequest

  8. def toString(): String
    Definition Classes
    ResourceProfile → AnyRef → Any