FAQ
Hi,

I set in CM to automatically restart datanode HDFS services when there is a
failure, but seems CM it not doing its job.

CM version 4.6.0
CDH version 4.3.0

java.io.IOException: block pool BP-833234772-10.84.90.12-1362685802508 is
not found
         at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.getBlockPoolSlice(FsVolumeImpl.java:122)
         at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.createTmpFile(FsVolumeImpl.java:150)
         at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.createTemporary(FsDatasetImpl.java:820)
         at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.createTemporary(FsDatasetImpl.java:92)
         at
org.apache.hadoop.hdfs.server.datanode.BlockReceiver.(DataXceiver.java:451)
         at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:103)
         at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:67)
         at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:221)
         at java.lang.Thread.run(Thread.java:662)
2013-06-18 07:31:01,395 WARN
org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
2013-06-18 07:31:01,397 INFO org.apache.hadoop.util.ExitUtil: Exiting with
status 0
2013-06-18 *07:31:01,399* INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at
108.168.xxx.xxx-static.reverse.softlayer.com/108.168.xxx.xxx
************************************************************/
2013-06-18 *18:00:34,511* INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: <-- This is a
manual restart
/************************************************************

thanks
Robin

Search Discussions

  • Philip Zeyliger at Jun 18, 2013 at 10:54 pm
    Hi Robin,

    It looks like the DataNode exited with a zero exit status, which will make
    us not restart it. Did it shut itself down? I'd like to understand a bit
    more of why it shut itself down. The datanode log (more than what you've
    got so far) would be helpful.

    -- Philip

    On Tue, Jun 18, 2013 at 11:46 AM, Robin Li wrote:

    Hi,

    I set in CM to automatically restart datanode HDFS services when there is
    a failure, but seems CM it not doing its job.

    CM version 4.6.0
    CDH version 4.3.0

    java.io.IOException: block pool BP-833234772-10.84.90.12-1362685802508 is
    not found
    at
    org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.getBlockPoolSlice(FsVolumeImpl.java:122)
    at
    org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.createTmpFile(FsVolumeImpl.java:150)
    at
    org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.createTemporary(FsDatasetImpl.java:820)
    at
    org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.createTemporary(FsDatasetImpl.java:92)
    at
    org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:155)
    at
    org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:451)
    at
    org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:103)
    at
    org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:67)
    at
    org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:221)
    at java.lang.Thread.run(Thread.java:662)
    2013-06-18 07:31:01,395 WARN
    org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
    2013-06-18 07:31:01,397 INFO org.apache.hadoop.util.ExitUtil: Exiting with
    status 0
    2013-06-18 *07:31:01,399* INFO
    org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down DataNode at
    108.168.xxx.xxx-static.reverse.softlayer.com/108.168.xxx.xxx
    ************************************************************/
    2013-06-18 *18:00:34,511* INFO
    org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: <-- This is
    a manual restart
    /************************************************************

    thanks
    Robin

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedJun 18, '13 at 6:46p
activeJun 18, '13 at 10:54p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Philip Zeyliger: 1 post Robin Li: 1 post

People

Translate

site design / logo © 2022 Grokbase