Hadoop keeps track of all the submitted jobs in the logs directory. The job history logs contain information for each job such as the total run time and the run time of each task. In this section, we will show you how to check the job history logs through a web UI.
We assume that our Hadoop cluster has been properly configured and all daemons are running without any issues.
Perform the following steps to check job history logs from a web UI:
Open the job history URL,
http://master:50030/jobhistoryhome.jsp
.We will be able to get a web page similar to the following screenshot:
On the web UI, we can filter jobs based on the username and job name in the format username:jobname as shown in the screenshot.
username
should be the username that runs a certain job, andjob
name should contain keywords of Hadoop jobs.From the web UI, we will be able to get a list of jobs in the Available Jobs in History section. By clicking on the Job Id...