In this section, we'll cover the installation of Hadoop and YARN and their configuration for a single-node and single-cluster setup. Now, we will consider Hadoop as two different components: one is Hadoop Distributed File System (HDFS), the other is YARN. The YARN components take care of resource allocation and the scheduling of the jobs that run over the data stored in HDFS. We'll cover most of the configurations to make YARN distributed computing more optimized and efficient.
In this chapter, we will cover the following topics:
Hadoop and YARN single-node installation
Hadoop and YARN fully-distributed mode installation
Operating Hadoop and YARN clusters