Book Image

Learning Storm

By : Ankit Jain, Anand Nalya
Book Image

Learning Storm

By: Ankit Jain, Anand Nalya

Overview of this book

<p>Starting with the very basics of Storm, you will learn how to set up Storm on a single machine and move on to deploying Storm on your cluster. You will understand how Kafka can be integrated with Storm using the Kafka spout.</p> <p>You will then proceed to explore the Trident abstraction tool with Storm to perform stateful stream processing, guaranteeing single message processing in every topology. You will move ahead to learn how to integrate Hadoop with Storm. Next, you will learn how to integrate Storm with other well-known Big Data technologies such as HBase, Redis, and Kafka to realize the full potential of Storm.</p> <p>Finally, you will perform in-depth case studies on Apache log processing and machine learning with a focus on Storm, and through these case studies, you will discover Storm's realm of possibilities.</p>
Table of Contents (16 chapters)
Learning Storm
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Index

Monitoring a topology using the Storm UI


This section covers how we can monitor the Storm cluster through the Storm UI. Let's first start with the definition of monitoring. Monitoring is used to track the health of various components that are running in a cluster. The statistics or information collected through monitoring is used by an administrator to spot an error or bottleneck in a cluster. The Storm UI daemon provides the following important information:

  • Cluster Summary: This portion of the Storm UI shows the version of Storm deployed in a cluster, uptime of the nimbus node, number of free worker slots, number of used worker slots, and so on. While submitting a topology to the cluster, the user first needs to make sure that the value of the Free slots column should not be zero; otherwise, the topology doesn't get any worker for processing and will wait in the queue till a worker becomes free.

  • Nimbus Configuration: This portion of the Storm UI shows the configuration of the Nimbus node...