classBlockGenerator extends Serializable with Logging
Batches objects created by a spark.streaming.NetworkReceiver and puts them into
appropriately named blocks at regular intervals. This class starts two threads,
one to periodically start a new batch and prepare the previous batch of as a block,
the other to push the blocks into the block manager.
Linear Supertypes
Logging, Serializable, Serializable, AnyRef, Any
Ordering
Alphabetic
By inheritance
Inherited
Hide All
Show all
BlockGenerator
Logging
Serializable
Serializable
AnyRef
Any
Visibility
Public
All
Instance Constructors
newBlockGenerator(storageLevel: StorageLevel)
Type Members
case classBlock(id: String, buffer: ArrayBuffer[T], metadata: Any) extends Product with Serializable
Batches objects created by a spark.streaming.NetworkReceiver and puts them into appropriately named blocks at regular intervals. This class starts two threads, one to periodically start a new batch and prepare the previous batch of as a block, the other to push the blocks into the block manager.