-
Book Overview & Buying
-
Table Of Contents
Python Data Analysis - Fourth Edition
By :
MapReduce is a programming model or framework for processing large distributed data. It processes data that resides on hundreds of machines. It is a simple, elegant, and easy-to-understand programming model. It is based on the parallel computation of the job in a distributed environment. It processes a large amount of data in a reasonable time. Here, distribution means parallel computing of the same task on each CPU with a different dataset. A MapReduce program can be written in JAVA, Python, and C++.
MapReduce has two basic operations: The first operation is applied to each of the input records, and the second operation aggregates the output results. MapReduce must define two functions:
The map task takes a set of input files that are distributed over the Hadoop Distributed File System (HDFS)...