In this recipe, we will describe how to troubleshoot the error shown in the following RegionServer logs:
2012-02-18 18:46:04,907 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer Exception: java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:640)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2830)
To fix this error, you will need root privileges on every node of the cluster. We assume you use the hadoop
user to start your HDFS and HBase clusters.
To fix the "unable to create new native thread" error, execute the following steps on every node of the cluster:
1. Increase the maximum number of processes of the
hadoop
user by adding the following properties to the/etc/security/limits.conf
file:$ vi /etc/security/limits.conf hadoop soft nproc 32000 hadoop hard nproc 32000
2. Add the...