Book Image

Learning Storm

By : Ankit Jain, Anand Nalya
Book Image

Learning Storm

By: Ankit Jain, Anand Nalya

Overview of this book

<p>Starting with the very basics of Storm, you will learn how to set up Storm on a single machine and move on to deploying Storm on your cluster. You will understand how Kafka can be integrated with Storm using the Kafka spout.</p> <p>You will then proceed to explore the Trident abstraction tool with Storm to perform stateful stream processing, guaranteeing single message processing in every topology. You will move ahead to learn how to integrate Hadoop with Storm. Next, you will learn how to integrate Storm with other well-known Big Data technologies such as HBase, Redis, and Kafka to realize the full potential of Storm.</p> <p>Finally, you will perform in-depth case studies on Apache log processing and machine learning with a focus on Storm, and through these case studies, you will discover Storm's realm of possibilities.</p>
Table of Contents (16 chapters)
Learning Storm
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Index

Exploring machine learning


Machine learning is a branch of applied computer science in which we build models of real-world phenomena on the basis of existing data available for analysis, and then using that model, we predict certain characteristics of data never seen before by the model. Machine learning techniques are one of the important ways in which decisions are made in applications. As most of the applications operate in real time, using machine learning with Storm is a great way to implement decision making in real-time applications.

Graphically, the process of machine learning can be represented by the following diagram:

Machine learning

The process of building the model from data is called training in the machine learning terminology. Training can happen in real time on a stream of data or can also be done on historical data. When the training is done in real time, the model evolves over time with the changed data. This kind of learning is referred to as online learning, and when...