Book Image

Real-time Analytics with Storm and Cassandra

By : Shilpi Saxena
Book Image

Real-time Analytics with Storm and Cassandra

By: Shilpi Saxena

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
Real-time Analytics with Storm and Cassandra
Shilpi Saxena
Mar, 2015 | 220 pages
No titles found
Table of Contents (19 chapters)
Real-time Analytics with Storm and Cassandra
Real-time Analytics with Storm and Cassandra
Credits
Credits
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Let's Understand Storm
Let's Understand Storm
Distributed computing problems
Solutions for complex distributed use cases
A high-level view of various components of Storm
Delving into the internals of Storm
Quiz time
Summary
2
Getting Started with Your First Topology
Getting Started with Your First Topology
Prerequisites for setting up Storm
Components of a Storm topology
Executing a sample Storm topology – local mode
Executing the topology in the distributed mode
Executing the topology from Command Prompt
Quiz time
Summary
3
Understanding Storm Internals by Examples
Understanding Storm Internals by Examples
Customizing Storm spouts
Anchoring and acking
Stream groupings
Quiz time
Summary
4
Storm in a Clustered Mode
Storm in a Clustered Mode
The Storm cluster setup
Zookeeper configurations
Storm configurations
Storm monitoring tools
Quiz time
Summary
5
Storm High Availability and Failover
Storm High Availability and Failover
An overview of RabbitMQ
Installing the RabbitMQ cluster
Integrating Storm with RabbitMQ
Building high availability of components
The Storm isolation scheduler
Quiz time
Summary
6
Adding NoSQL Persistence to Storm
Adding NoSQL Persistence to Storm
The advantages of Cassandra
Columnar database fundamentals
Setting up the Cassandra cluster
Multiple data centers
Introduction to CQLSH
Introduction to CLI
Using different client APIs to access Cassandra
Storm topology wired to the Cassandra store
The best practices for Storm/Cassandra applications
Quiz time
Summary
7
Cassandra Partitioning, High Availability, and Consistency
Cassandra Partitioning, High Availability, and Consistency
Consistent hashing
Replication in Cassandra and strategies
Cassandra consistency
Quiz time
Summary
8
Cassandra Management and Maintenance
Cassandra Management and Maintenance
Cassandra – gossip protocol
Cassandra cluster scaling – adding a new node
Cassandra cluster – replacing a dead node
The replication factor
The nodetool commands
Cassandra fault tolerance
Cassandra monitoring systems
Quiz time
Summary
9
Storm Management and Maintenance
Storm Management and Maintenance
Scaling the Storm cluster – adding new supervisor nodes
Scaling the Storm cluster and rebalancing the topology
Setting up workers and parallelism to enhance processing
Storm troubleshooting
Quiz time
Summary
10
Advance Concepts in Storm
Advance Concepts in Storm
Building a Trident topology
Understanding the Trident API
Examples and illustrations
Quiz time
Summary
11
Distributed Cache and CEP with Storm
Distributed Cache and CEP with Storm
The need for distributed caching in Storm
Introduction to memcached
Introduction to the complex event processing engine
Quiz time
Summary
Quiz Answers
Quiz Answers
Chapter 1
Chapter 2
Chapter 3
Chapter 4
Chapter 5
Chapter 6
Chapter 7
Chapter 8
Chapter 9
Chapter 10
Chapter 11
Index
Index

Executing the topology from Command Prompt

Once the UI is visible and all the daemons are started, the topology can be submitted on Nimbus using the following command:

storm jar storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar  storm.starter.WordCountTopology WordCount -c nimbus.host=localhost

The Storm UI with the WordCount topology running in distributed mode is shown here. It depicts the topology state, uptime, and other details (we shall discuss the features of the UI in detail in a later chapter). We can kill the topology from the UI.

Tweaking the WordCount topology to customize it

Now that we have deployed the WordCount topology in distributed mode, let's tweak the code in the bolts a bit to write WordCount onto a file. To achieve this, we will proceed with the following steps:

  1. We intend to create a new bolt, FileWriterBolt, to achieve this. Open WordCountTopology.java and add the following snippet to WordCountTopology.java:

    public static class FileWriterBolt extends BaseBasicBolt...
Previous Section
End of Section 6
Next Section