Packages

class SparkEnv extends Logging

Developer API

Holds all the runtime environment objects for a running Spark instance (either master or worker), including the serializer, RpcEnv, block manager, map output tracker, etc. Currently Spark code finds the SparkEnv through a global variable, so all the threads can access the same SparkEnv. It can be accessed by SparkEnv.get (e.g. after creating a SparkContext).

Annotations
@DeveloperApi()
Source
SparkEnv.scala
Linear Supertypes
Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SparkEnv
  2. Logging
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SparkEnv(executorId: String, rpcEnv: RpcEnv, serializer: Serializer, closureSerializer: Serializer, serializerManager: SerializerManager, mapOutputTracker: MapOutputTracker, shuffleManager: ShuffleManager, broadcastManager: BroadcastManager, blockManager: BlockManager, securityManager: SecurityManager, metricsSystem: MetricsSystem, memoryManager: MemoryManager, outputCommitCoordinator: OutputCommitCoordinator, conf: SparkConf)

Value Members

  1. val blockManager: BlockManager
  2. val broadcastManager: BroadcastManager
  3. val closureSerializer: Serializer
  4. val conf: SparkConf
  5. val executorId: String
  6. val mapOutputTracker: MapOutputTracker
  7. val memoryManager: MemoryManager
  8. val metricsSystem: MetricsSystem
  9. val outputCommitCoordinator: OutputCommitCoordinator
  10. val securityManager: SecurityManager
  11. val serializer: Serializer
  12. val serializerManager: SerializerManager
  13. val shuffleManager: ShuffleManager