spark.streaming

examples

package examples

Visibility
  1. Public
  2. All

Type Members

  1. class FeederActor extends Actor

    Sends the random content to every receiver subscribed with 1/2 second delay.

  2. class JavaFlumeEventCount extends AnyRef

  3. class JavaNetworkWordCount extends AnyRef

  4. class JavaQueueStream extends AnyRef

  5. class SampleActorReceiver[T] extends Actor with Receiver

    A sample actor as receiver, is also simplest.

  6. case class SubscribeReceiver(receiverActor: ActorRef) extends Product with Serializable

  7. case class UnsubscribeReceiver(receiverActor: ActorRef) extends Product with Serializable

Value Members

  1. object ActorWordCount extends AnyRef

    A sample word count program demonstrating the use of plugging in Actor as Receiver Usage: ActorWordCount <master> <hostname> <port> <master> is the Spark master URL.

  2. object FeederActor extends AnyRef

    A sample feeder actor

  3. object FlumeEventCount extends AnyRef

    Produces a count of events received from Flume.

  4. object HdfsWordCount extends AnyRef

    Counts words in new text files created in the given directory Usage: HdfsWordCount <master> <directory> <master> is the Spark master URL.

  5. object JavaFlumeEventCount extends

  6. object JavaNetworkWordCount extends

  7. object JavaQueueStream extends

  8. object KafkaWordCount extends AnyRef

    Consumes messages from one or more topics in Kafka and does wordcount.

  9. object KafkaWordCountProducer extends AnyRef

  10. object NetworkWordCount extends AnyRef

    Counts words in UTF8 encoded, '\n' delimited text received from the network every second.

  11. object QueueStream extends AnyRef

  12. object RawNetworkGrep extends AnyRef

    Receives text from multiple rawNetworkStreams and counts how many '\n' delimited lines have the word 'the' in them.

  13. object SimpleZeroMQPublisher extends AnyRef

    A simple publisher for demonstration purposes, repeatedly publishes random Messages every one second.

  14. object TwitterAlgebirdCMS extends AnyRef

    Illustrates the use of the Count-Min Sketch, from Twitter's Algebird library, to compute windowed and global Top-K estimates of user IDs occurring in a Twitter stream.

  15. object TwitterAlgebirdHLL extends AnyRef

    Illustrates the use of the HyperLogLog algorithm, from Twitter's Algebird library, to compute a windowed and global estimate of the unique user IDs occurring in a Twitter stream.

  16. object TwitterPopularTags extends AnyRef

    Calculates popular hashtags (topics) over sliding 10 and 60 second windows from a Twitter stream.

  17. object ZeroMQWordCount extends AnyRef

    A sample wordcount with ZeroMQStream stream

  18. package clickstream