Ganglia is a monitoring system designed for use with clusters and grids. Hadoop can be configured to send periodic metrics to the Ganglia monitoring daemon, which is useful for diagnosing and monitoring the health of the Hadoop cluster. This recipe will explain how to configure Hadoop to send metrics to the Ganglia monitoring daemon.
Ensure that you have Ganglia Version 3.1 or better installed on all of the nodes in the Hadoop cluster. The Ganglia monitoring daemon (gmond
) should be running on every worker node in the cluster. You will also need the Ganglia meta daemon (gmetad
) running on at least one node, and another node running the Ganglia web frontend.
The following is an example with modified gmond.conf
file that can be used by the gmond
daemon:
cluster { name = "Hadoop Cluster" owner = "unspecified" latlong = "unspecified" url = "unspecified" } host { location = "my datacenter" } udp_send_channel { host = mynode.company...