Book Image

Apache Mahout Essentials

By : Jayani Withanawasam
Book Image

Apache Mahout Essentials

By: Jayani Withanawasam

Overview of this book

Table of Contents (13 chapters)
Apache Mahout Essentials
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Monitoring Hadoop


Apache Hadoop daemons can be monitored using different mechanisms.

Commands/scripts

The running JVMs related to Hadoop can be displayed using the following command (use the correct Java installation location):

/usr/lib/jvm/java-7-oracle/bin/jps

The outcome of the preceding command is given in the following figure:

Data nodes

Active data nodes in the cluster can be displayed using the following command:

[Hadoop installation directory]/bin/hdfs dfsadmin –report

The outcome of the preceding command for a cluster with two data nodes is shown in the following figure:

Node managers

Active node managers can be monitored using the following command:

 [Hadoop installation directory]/bin /yarn node –list

The outcome of the preceding command for a cluster with two node managers is shown in the following figure:

Web UIs

Apache Hadoop has provided Web UIs to monitor MapReduce job processing details.

As shown in the following figure, NameNode operations in HDFS can be monitored at http://localhost...