Automatically Restart Process on DataNode not working?

On Tue, Jun 18, 2013 at 11:46 AM, Robin Li wrote:

Hi,

I set in CM to automatically restart datanode HDFS services when there is
a failure, but seems CM it not doing its job.

CM version 4.6.0
CDH version 4.3.0

java.io.IOException: block pool BP-833234772-10.84.90.12-1362685802508 is
not found
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.getBlockPoolSlice(FsVolumeImpl.java:122)
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.createTmpFile(FsVolumeImpl.java:150)
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.createTemporary(FsDatasetImpl.java:820)
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.createTemporary(FsDatasetImpl.java:92)
at
org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:155)
at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:451)
at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:103)
at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:67)
at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:221)
at java.lang.Thread.run(Thread.java:662)
2013-06-18 07:31:01,395 WARN
org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
2013-06-18 07:31:01,397 INFO org.apache.hadoop.util.ExitUtil: Exiting with
status 0
2013-06-18 *07:31:01,399* INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at
108.168.xxx.xxx-static.reverse.softlayer.com/108.168.xxx.xxx
************************************************************/
2013-06-18 *18:00:34,511* INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: <-- This is
a manual restart
/************************************************************

thanks
Robin