Book Image

YARN Essentials

Book Image

YARN Essentials

Overview of this book

Table of Contents (17 chapters)
YARN Essentials
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Free Chapter
1
Need for YARN
9
YARN – Alternative Solutions
Index

Core components of YARN architecture


Here are some core components of YARN architecture that we need to know:

  • ResourceManager

  • ApplicationMaster

  • NodeManager

ResourceManager

ResourceManager acts as a global resource scheduler that is responsible for resource management and scheduling as per the ApplicationMaster's requests for the resource requirements of the application(s). It is also responsible for the management of hierarchical job queues. The ResourceManager can be seen in the following figure:

The preceding diagram gives more details about the components of the ResourceManager. The Admin and Client service is responsible for client interactions, such as a job request submission, start, restart, and so on. The ApplicationsManager is responsible for the management of every application. The ApplicationMasterService interacts with every application. ApplicationMaster regarding resource or container negotiation, the ResourceTrackerService coordinates with the NodeManager and ResourceManager. The...