YARN consists of various efficient and scalable components that make it a powerful, robust, and preferable resource management framework. In order to have a better understanding of YARN offerings and how to integrate YARN, users need to have in-depth knowledge of various YARN components. This chapter explains the internals of YARN components, the classes involved, and how YARN components interact with each other. The component's insights provided in this chapter will enable users to leverage the features of YARN and integrate YARN with distributed application frameworks easily.
In this chapter, we will cover the following topics:
Working with auxiliary services, resource localization, log aggregation
An overview of Timeline server, web application proxy, and YARN scheduler load simulator