Book Image

Storm Blueprints: Patterns for Distributed Real-time Computation

Book Image

Storm Blueprints: Patterns for Distributed Real-time Computation

Overview of this book

Table of Contents (17 chapters)
Storm Blueprints: Patterns for Distributed Real-time Computation
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Index

Introducing Whirr Storm


The Whirr Storm project (https://github.com/ptgoetz/whirr-storm) is a Whirr service implementation for configuring Storm clusters. Whirr Storm supports the configuration of all Storm daemons as well as full control over Storm's storm.yaml configuration file.

Setting up Whirr Storm

To install the Whirr Storm service, simply place the JAR file in the $WHIRR_HOME/lib directory as follows:

wget http://repo1.maven.org/maven2/com/github/ptgoetz/whirr-storm/1.0.0/whirr-storm-1.0.0.jar -P $WHIRR_HOME/lib

Next, verify the installation by running the Whirr command without arguments to print a list of instance roles available to Whirr. The list should now include the roles provided by Whirr Storm as shown in the following code snippet:

$ whirr

  storm-drpc
  storm-logviewer
  storm-nimbus
  storm-supervisor
  storm-ui

Cluster configuration

In our previous Whirr example, we created a cluster of three nodes where each node had only the ZooKeeper role. Whirr allows you to assign multiple...