Book Image

Learning Big Data with Amazon Elastic MapReduce

By : Amarkant Singh, Vijay Rayapati
Book Image

Learning Big Data with Amazon Elastic MapReduce

By: Amarkant Singh, Vijay Rayapati

Overview of this book

<p>Amazon Elastic MapReduce is a web service used to process and store vast amount of data, and it is one of the largest Hadoop operators in the world. With the increase in the amount of data generated and collected by many businesses and the arrival of cost-effective cloud-based solutions for distributed computing, the feasibility to crunch large amounts of data to get deep insights within a short span of time has increased greatly.</p> <p>This book will get you started with AWS so that you can quickly create your own account and explore the services provided, many of which you might be delighted to use. This book covers the architectural details of the MapReduce framework, Apache Hadoop, various job models on EMR, how to manage clusters on EMR, and the command-line tools available with EMR. Each chapter builds on the knowledge of the previous one, leading to the final chapter where you will learn about solving a real-world use case using Apache Hadoop and EMR. This book will, therefore, get you up and running with major Big Data technologies quickly and efficiently.</p>
Table of Contents (18 chapters)
Learning Big Data with Amazon Elastic MapReduce
Credits
About the Authors
Acknowledgments
About the Reviewers
www.PacktPub.com
Preface
Index

Use case definition


As we have seen in our first chapter, Amazon CloudFront is a content delivery web service that helps end users to distribute content with low-latency to their customers. Amazon CloudFront uses its edge locations that are spread across the world to deliver content. Requests originating from any place are served by the nearest edge location resulting in the desired low latency.

Now, say you are using Amazon CloudFront as the CDN service for your website and you want to know the access trends across the world for your website. Basically, you want to get the total request count, hit count, miss count, error count, per city per country. You want to be able to see how many bytes have been transferred per edge location. You also want to get the breakdown of all the requests on the basis of HTTP status codes. That is, for example, how many 404 errors were there.

So, our use case here is to get insights from Amazon CloudFront access logs analysis.