Hadoop has a few memory configuration properties. Their values should be set according to the configurations of the cluster. In this recipe, we will outline steps to configure these memory properties.
We assume that the Hadoop cluster has been properly configured and all the daemons are running without any issues.
Log in from the Hadoop cluster administrator machine to the cluster master node using the following command:
ssh hduser@master
We can use the following steps to configure memory properties for a Hadoop cluster:
Stop the MapReduce cluster with the following command:
stop-mapred.sh
Configure the virtual memory size, in megabytes, for a map task used by a scheduler by changing the following property:
<property> <name>mapred.cluster.map.memory.mb</name> <value>200</value>...