Book Image

YARN Essentials

By : Fasale, Nirmal Kumar
Book Image

YARN Essentials

By: Fasale, Nirmal Kumar

Overview of this book

If you have a working knowledge of Hadoop 1.x but want to start afresh with YARN, this book is ideal for you. You will be able to install and administer a YARN cluster and also discover the configuration settings to fine-tune your cluster both in terms of performance and scalability. This book will help you develop, deploy, and run multiple applications/frameworks on the same shared YARN cluster.
Table of Contents (12 chapters)
Free Chapter
1
1. Need for YARN
9
9. YARN – Alternative Solutions
11
Index

What this book covers

Chapter 1, Need for YARN, discusses the motivation behind the development of YARN. This chapter discusses what YARN is and why it is needed.

Chapter 2, YARN Architecture, is a deep dive into YARN's architecture. All the major components and their inner workings are explained in this chapter.

Chapter 3, YARN Installation, describes the steps required to set up a single-node and fully-distributed YARN cluster. It also talks about the important configurations/properties that you should be aware of while installing the YARN cluster.

Chapter 4, YARN and Hadoop Ecosystems, talks about Hadoop with respect to YARN. It gives a short introduction to the Hadoop 1.x version, the architectural differences between Hadoop 1.x and Hadoop 2.x, and where exactly YARN fits into Hadoop 2.x.

Chapter 5, YARN Administration, covers information on the administration of YARN clusters. It explains the administrative tools that are available in YARN, what they mean, and how to use them. This chapter covers various topics from YARN container allocation and configuration to various scheduling policies/configurations and in-built support for multitenancy.

Chapter 6, Developing and Running a Simple YARN Application, focuses on some real applications with YARN, with some hands-on examples. It explains how to write a YARN application, how to submit an application to YARN, and finally, how to monitor the application.

Chapter 7, YARN Frameworks, discusses the various emerging open source frameworks that are developed to run on top of YARN. The chapter then talks in detail about Apache Samza and Storm on YARN, where we will develop and run some sample applications using these frameworks.

Chapter 8, Failures in YARN, discusses the fault-tolerance aspect of YARN. This chapter focuses on various failures that can occur in the YARN framework, their causes, and how YARN gracefully handles those failures.

Chapter 9, YARN – Alternative Solutions, discusses other alternative solutions that are available on the market today. These systems, like YARN, share common inspiration/requirements and the high-level goal of improving scalability, latency, fault-tolerance, and programming model flexibility. This chapter highlights the key differences in the way these alternative solutions address the same features provided by YARN.

Chapter 10, YARN Future and Support, talks about YARN's journey and its present and future in the world of distributed computing.