Package org.apache.spark.resource

Class TaskResourceRequest

Object
org.apache.spark.resource.TaskResourceRequest
All Implemented Interfaces:
Serializable
public class TaskResourceRequest extends Object implements Serializable
A task resource request. This is used in conjunction with the ResourceProfile to programmatically specify the resources needed for an RDD that will be applied at the stage level.

Use TaskResourceRequests class as a convenience API.

param: resourceName Resource name param: amount Amount requesting as a Double to support fractional resource requests. For custom resources, valid values are less than or equal to 1.0 or whole numbers, since a task's amount must map onto discrete resource addresses - ie amount equals 0.5 translates into 2 tasks per resource address. CPUs (resource name "cpus") are a plain quantity drawn from the executor's core pool rather than an addressable resource, so any amount from 1e-9 through Int.MaxValue after rounding is valid, e.g. 1.5; the cpus amount is rounded to the nearest 1e-9, so precision beyond 9 decimal places is not preserved.

See Also:

  • Constructor Details

    • TaskResourceRequest

      public TaskResourceRequest(String resourceName, double amount)

  • Method Details

    • amount

      public double amount()

    • equals

      public boolean equals(Object obj)
      Overrides:
      equals in class Object

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • resourceName

      public String resourceName()

    • toString

      public String toString()
      Overrides:
      toString in class Object