In this recipe, we will describe how to troubleshoot the following XceiverCount error shown in the DataNode logs:
2012-02-18 17:08:10,695 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.166.111.191:50010, storageID=DS-2072496811-10.168.130.82-50010-1321345166369, infoPort=50075, ipcPort=50020):DataXceiver
java.io.IOException: xceiverCount 257 exceeds the limit of concurrent xcievers 256
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run (DataXceiver.java:92)
at java.lang.Thread.run(Thread.java:662)
The following are the steps to fix the XceiverCount error:
1. Add the following snippet to the HDFS setting file (
hdfs-site.xml
):hadoop@master1$ vi $HADOOP_HOME/conf/hdfs-site.xml <property> <name>dfs.datanode.max.xcievers</name> <value>4096</value> </property>
2. Sync the
hdfs-site.xml
file across the cluster:hadoop@master1$ for slave...