Book Image

Learning Storm

By : Ankit Jain, Anand Nalya
Book Image

Learning Storm

By: Ankit Jain, Anand Nalya

Overview of this book

<p>Starting with the very basics of Storm, you will learn how to set up Storm on a single machine and move on to deploying Storm on your cluster. You will understand how Kafka can be integrated with Storm using the Kafka spout.</p> <p>You will then proceed to explore the Trident abstraction tool with Storm to perform stateful stream processing, guaranteeing single message processing in every topology. You will move ahead to learn how to integrate Hadoop with Storm. Next, you will learn how to integrate Storm with other well-known Big Data technologies such as HBase, Redis, and Kafka to realize the full potential of Storm.</p> <p>Finally, you will perform in-depth case studies on Apache log processing and machine learning with a focus on Storm, and through these case studies, you will discover Storm's realm of possibilities.</p>
Table of Contents (16 chapters)
Learning Storm
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Index

Integrating Storm with Redis


Redis is a key value data store. The key values can be strings, lists, sets, hashes, and so on. It is extremely fast because the entire dataset is stored in the memory. The following are the steps to install Redis:

  1. First, you will need to install make, gcc, and cc to compile the Redis code using the following command:

    sudo yum -y install make gcc cc
    
  2. Download, unpack, and make Redis, and copy it to /usr/local/bin using the following commands:

    cd /home/$USER
    

    Here, $USER is the name of the Linux user.

    http://download.redis.io/releases/redis-2.6.16.tar.gz
    tar -xvf redis-2.6.16.tar.gz
    cd redis-2.6.16
    make
    sudo cp src/redis-server /usr/local/bin
    sudo cp src/redis-cli /usr/local/bin
    
  3. Execute the following commands to make Redis as a service:

    sudo mkdir -p /etc/redis
    sudo mkdir -p /var/redis
    cd /home/$USER/redis-2.6.16/
    sudo cp utils/redis_init_script /etc/init.d/redis
    wget https://bitbucket.org/ptylr/public-stuff/raw/41d5c8e87ce6adb34aa16cd571c3f04fb4d5e7ac/etc/init.d...