The configuration of a Hadoop cluster is not done before the validation step. Validation plays an important role in the configuration of a Hadoop cluster; for example, it can help us figure out configuration problems.
The most straightforward way to validate a Hadoop cluster configuration is to run a MapReduce job from the master node. Alternatively, there are two methods to validate the cluster configuration. One is from web interface and the other is from the command line. In this recipe, we will list steps to validate the configuration of a Hadoop cluster.
To validate the configuration from the web interface, a web browser such as Firefox or Google Chrome is needed. Sometimes if a GUI web browser is not available, we can use a command line based web browser such as elinks
and lynx
. In this book, we assume to use elinks
for illustration purpose.
We assume that elinks
has been installed with the following command:
sudo yum install elinks
Start all...