Hadoop has many parameters that affect its performance and fault tolerance behavior. You may want to tune the following options suitable for your cluster and workload.
This is used to control the amount of resources allocated to Hadoop tasks. By setting the following parameters in conf/core-site.xml
, Mesos will be instructed to assign an appropriate CPU, memory (in MB), and diskspace (in MB) resources.
<property> <name>mapred.mesos.slot.cpus</name> <value>1</value> </property> <property> <name>mapred.mesos.slot.mem</name> <value>1024</value> </property> <property> <name>mapred.mesos.slot.disk</name> <value>1024</value> </property>
The following parameters control the resource policies of Mesos:
mapred...