YARN separates the role of Job Tracker into two separate entities. A Resource Manager is a central authority and is responsible for allocation and management of cluster resources, and an application master to manage the life cycle of applications that are running on the cluster. The following diagram depicts YARN architecture and the flow of requests-response:
YARN provides the basic units of applications such as memory, CPU, and GPU. The units of an application are utilized by containers. All containers are managed by respective Node Managers running on the Hadoop cluster. The Application master (AM) negotiates with the Resource Manager (RM) for container availability along with the resource manager. The AM container is initialized by client through resource manager as shown in step 2. Once AM is initialized, it demands container availability...