Packages

p

org.apache.spark

resource

package resource

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. trait ResourceAllocator extends AnyRef

    Trait used to help executor/worker allocate resources.

    Trait used to help executor/worker allocate resources. Please note that this is intended to be used in a single thread.

  2. class ResourceDiscoveryScriptPlugin extends ResourceDiscoveryPlugin with Logging

    The default plugin that is loaded into a Spark application to control how custom resources are discovered.

    The default plugin that is loaded into a Spark application to control how custom resources are discovered. This executes the discovery script specified by the user and gets the json output back and constructs ResourceInformation objects from that. If the user specifies custom plugins, this is the last one to be executed and throws if the resource isn't discovered.

    Annotations
    @DeveloperApi()
    Since

    3.0.0

  3. class ResourceID extends AnyRef

    Resource identifier.

    Resource identifier.

    Annotations
    @DeveloperApi()
    Since

    3.0.0

  4. class ResourceInformation extends Serializable

    Class to hold information about a type of Resource.

    Class to hold information about a type of Resource. A resource could be a GPU, FPGA, etc. The array of addresses are resource specific and its up to the user to interpret the address.

    One example is GPUs, where the addresses would be the indices of the GPUs

    Annotations
    @Evolving()
    Since

    3.0.0

  5. class ResourceRequest extends AnyRef

    Class that represents a resource request.

    Class that represents a resource request.

    The class used when discovering resources (using the discovery script), or via the context as it is parsing configuration for the ResourceID.

    Annotations
    @DeveloperApi()
    Since

    3.0.0

Value Members

  1. object ResourceProfile extends Logging with Serializable

Ungrouped