Book Image

Monitoring Hadoop

By : Aman Singh
Book Image

Monitoring Hadoop

By: Aman Singh

Overview of this book

Table of Contents (14 chapters)

MapReduce control commands


Hadoop provides a job command to interact with map reducers, using which the administrator can control the jobs or tasks submitted to the cluster.

  • The <options> part of hadoop job <options> is explained in the following table:

    Option

    Description

    -list

    This command lists all the running jobs in a cluster. This is for MapReduce version 1.

    -list all

    This command lists all the jobs in a cluster.

    -status <job-id>

    This gives information about the job counter and the MapReduce completion percentage.

    -kill <job-id>

    Using this command, we can kill the long-running or stuck jobs.

    -history

    Gives details about the job, in terms of failed or successful tasks.

  • hadoop jobtracker -dumpConfiguration: This command is used to dump the JobTracker configuration along with all the queue information. This can be really helpful in doing a quick review of the configuration or as a backup.

  • hadoop queue <options>: The jobs submitted can...