In this recipe, we will take a look at YARN simulator, which is useful to test and determine the load of YARN under various test conditions.
The YARN Scheduler Load Simulator (SLS) is such a tool, which can simulate large-scale YARN clusters and application loads in a single machine within a single JVM.
For this recipe, you will need a single machine with Hadoop installed. For this, readers can refer to the first chapter, where we have covered a single node cluster setup.
Connect to the
master1.cyrus.com
single node and switch as userhadoop
.The SLS is located at
$HADOOP_HOME/share/hadoop/tools/sls/
.The SLS runs the simulator using the
sls-runner.xml
configuration file under$HADOOP_HOME/etc/hadoop
.A sample file is located at
$HADOOP_HOME/share/hadoop/tools/sls/sample-conf/sls-runner.xml
.The
sls-runner.xml
file contains parameters to tune a number of threads, container memory, NM threads, and many other parameters or the choice of scheduler you want.The...