Book Image

YARN Essentials

By : Fasale, Nirmal Kumar
Book Image

YARN Essentials

By: Fasale, Nirmal Kumar

Overview of this book

If you have a working knowledge of Hadoop 1.x but want to start afresh with YARN, this book is ideal for you. You will be able to install and administer a YARN cluster and also discover the configuration settings to fine-tune your cluster both in terms of performance and scalability. This book will help you develop, deploy, and run multiple applications/frameworks on the same shared YARN cluster.
Table of Contents (12 chapters)
Free Chapter
1
1. Need for YARN
9
9. YARN – Alternative Solutions
11
Index

YARN multitenancy application support


YARN comes with built-in multitenancy support. Now, let's have a look at what multitenancy means. Consider a society that has multiple apartments in it, so there are different types of family living in different apartments with security and privacy, but they all share the society's common areas, such as the society gate, garden, play area, and other amenities. Their apartments also share common walls. The same concept is followed in YARN: the that run running into the cluster share the cluster resources in a multitenant way. They share cluster processing capacity, cluster storage capacity, data access securities, and so on. Multitenancy is achieved in the cluster by differentiating applications into multiple business units, for example, different queues and users for different types of applications.

Security and privacy can be achieved by configuring Linux and HDFS permissions to separate files and directories to create tenant boundaries. This can be...