Book Image

Practical Data Analysis - Second Edition

By : Hector Cuesta, Dr. Sampath Kumar
Book Image

Practical Data Analysis - Second Edition

By: Hector Cuesta, Dr. Sampath Kumar

Overview of this book

Beyond buzzwords like Big Data or Data Science, there are a great opportunities to innovate in many businesses using data analysis to get data-driven products. Data analysis involves asking many questions about data in order to discover insights and generate value for a product or a service. This book explains the basic data algorithms without the theoretical jargon, and you’ll get hands-on turning data into insights using machine learning techniques. We will perform data-driven innovation processing for several types of data such as text, Images, social network graphs, documents, and time series, showing you how to implement large data processing with MongoDB and Apache Spark.
Table of Contents (21 chapters)
Practical Data Analysis - Second Edition
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface

An overview of MapReduce


MapReduce is a programming model for large-scale distributed data processing, inspired by the map and reduce functions of functional programming languages such as Lisp, Haskell, and Python. One of the most important features of MapReduce is that it allows us to hide the low-level implementation, such as message passing or synchronization, from users and split a problem into many partitions. This is a great way to make the parallelization of data processing easy, without any need for communication between the partitions.

Tip

The original Google paper MapReduce: Simplified Data Processing on Large Clusters, can be found in the following link: http://research.google.com/archive/mapreduce.html

MapReduce became mainstream because of Apache Hadoop, which is an open source framework that was derived from Google's MapReduce paper. MapReduce allows us to process massive amounts of data in a distributed cluster. In fact, there are many implementations of the MapReduce programming...