Book Image

Mastering Hadoop

By : Sandeep Karanth
Book Image

Mastering Hadoop

By: Sandeep Karanth

Overview of this book

Table of Contents (21 chapters)
Mastering Hadoop
Credits
About the Author
Acknowledgments
About the Reviewers
www.PacktPub.com
Preface
Index

The YARN architecture


The following figure illustrates the architecture of a YARN-based cluster. There are five major component types in a YARN cluster. They are as follows:

  • Resource Manager (RM): This is a per-cluster daemon that is solely responsible for allocating and managing resources available within the cluster.

  • Node Manager (NM): This is a per-node daemon that is responsible for local resource management. It is also the node-local representative of the RM.

  • Application Master (AM): This is a per-application daemon that encapsulates all application-specific logic and libraries. The AM is responsible for negotiating resources from the RM and working with the NM to execute them to completion.

  • Container: This is an abstract representation of a resource set that is given to a particular application. The AM is a specialized container that is used to bootstrap and manage the entire application's life cycle.

  • Client: This is the entity in the cluster that can submit applications to the RM...