Book Image

Hadoop Blueprints

By : Anurag Shrivastava, Tanmay Deshpande
Book Image

Hadoop Blueprints

By: Anurag Shrivastava, Tanmay Deshpande

Overview of this book

If you have a basic understanding of Hadoop and want to put your knowledge to use to build fantastic Big Data solutions for business, then this book is for you. Build six real-life, end-to-end solutions using the tools in the Hadoop ecosystem, and take your knowledge of Hadoop to the next level. Start off by understanding various business problems which can be solved using Hadoop. You will also get acquainted with the common architectural patterns which are used to build Hadoop-based solutions. Build a 360-degree view of the customer by working with different types of data, and build an efficient fraud detection system for a financial institution. You will also develop a system in Hadoop to improve the effectiveness of marketing campaigns. Build a churn detection system for a telecom company, develop an Internet of Things (IoT) system to monitor the environment in a factory, and build a data lake – all making use of the concepts and techniques mentioned in this book. The book covers other technologies and frameworks like Apache Spark, Hive, Sqoop, and more, and how they can be used in conjunction with Hadoop. You will be able to try out the solutions explained in the book and use the knowledge gained to extend them further in your own problem space.
Table of Contents (14 chapters)
Hadoop Blueprints
About the Authors
About the Reviewers

Creating the solution outline

A churn predictor or churn detector is a program that takes a dataset containing the customer records, one row per customer, as input. Each row is then fed to the churn prediction algorithm which predicts whether a customer will churn or not.

The churn predictor can simply be used in batch mode to generate outbound emails or calls, or it can be integrated with the inbound interactive channels, such as a website or call center. Once we know that the customer is likely to churn, then we can offer him or her an incentive, such as a special offer, to make him change his or her mind.

We can take a proactive or reactive approach to churn prevention. In the reactive approach, we offer special incentives to the customer when he or she informs us that he would like to terminate the service. This gives us a few weeks' time to retain the customer. The reactive approach is not very relevant for this chapter because, once the customer announces that he or she is planning to...