FAQ
Hey,

Hope anyone here could provide help on the hbase issue we got after our
of space. I could bring up HDFS via one of post found by manually
modifying namenode's /var/hdfs/current/edits file: $ printf
"\xff\xff\xff\xee\xff" > edits. However, the issue came to hbase
startup. We could see HMaster and HRegion processes running, but could
not access Hbase. The errors is described below:

I am appreciated by any help and suggestion. P.S: we're using apache
hadoop 0.20.2 and hbase 0.20.3, and zookeeper is running via
zookeeper-3.2.2 (not managed by Hbase).

Hbase.log:
2011-06-06 18:40:11,833 WARN regionserver.HRegionServer - Unable to
read master address from ZooKeeper. Retrying. Error was:
java.io.IOException:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =
NoNode for /hbase/master
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readAddressOrThrow(Zo
oKeeperWrapper.java:394)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readMasterAddressOrTh
row(ZooKeeperWrapper.java:298)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.getMaster(HRegionServ
er.java:1282)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegion
Server.java:1314)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.jav
a:430)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException:
KeeperErrorCode = NoNode for /hbase/master
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:892)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readAddressOrThrow(Zo
oKeeperWrapper.java:390)
... 5 more

Zookeeper.log:
2011-06-06 21:48:36,174 - WARN
[ProcessThread:-1:PrepRequestProcessor@402] - Got exception when
processing sessionid:0x23067fc51970002 type:create cxid:0x19a9
zxid:0xfffffffffffffffe txntype:unknown n/a
org.apache.zookeeper.KeeperException$NodeExistsException:
KeeperErrorCode = NodeExists
at
org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequestPro
cessor.java:245)
at
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcesso
r.java:114)


Regards,
Andy (Sheng) Zhong

Search Discussions

  • Stack at Jun 7, 2011 at 10:13 pm

    On Mon, Jun 6, 2011 at 8:29 PM, Zhong, Sheng wrote:
    I am appreciated by any help and suggestion. P.S: we're using apache
    hadoop 0.20.2 and hbase 0.20.3, and zookeeper is running via
    zookeeper-3.2.2 (not managed by Hbase).
    Can you upgrade you hbase and hadoop?
    St.Ack
  • Zhong, Sheng at Jun 7, 2011 at 10:32 pm
    Thanks! The issue has been resolved by removing some bad blks...

    But St.Ack,

    We do want a upgrade, and am starting the research. Pl help to provide
    your suggestion or comments:

    If we stick with apache version, the latest stable version is
    hadoop-0.20.203.0rc1.tar.gz. However, it may have potentially compatible
    issue with latest Hbase 0.90.2 according to Michel Noll, specified from
    http://www.michael-noll.com/blog/2011/04/14/building-an-hadoop-0-20-x-ve
    rsion-for-hbase-0-90-2/comment-page-1/#comment-19757:
    "As of today, Hadoop 0.20.2 is the latest stable release of Apache
    Hadoop that is marked as ready for production (neither 0.21 nor 0.22
    are). Unfortunately, Hadoop 0.20.2 release is not compatible with the
    latest stable version of HBase:" The paper suggests either uses
    branch-0.20-append or use hadoop jar found from HBASE.

    Andy


    -----Original Message-----
    From: saint.ack@gmail.com On Behalf Of
    Stack
    Sent: Tuesday, June 07, 2011 5:13 PM
    To: common-user@hadoop.apache.org
    Subject: Re: Hbase startup error: NoNode for /hbase/master after running
    out of space
    On Mon, Jun 6, 2011 at 8:29 PM, Zhong, Sheng wrote:
    I am appreciated by any help and suggestion. P.S: we're using apache
    hadoop 0.20.2 and hbase 0.20.3, and zookeeper is running via
    zookeeper-3.2.2 (not managed by Hbase).
    Can you upgrade you hbase and hadoop?
    St.Ack
  • Joey Echeverria at Jun 8, 2011 at 11:18 pm
    Hey Andy,

    You're correct that 0.20.203 doesn't have append. Your best bet is to
    build a version of the append branch or <shameless-plug>switch to
    CDH3u0</shameless-plug>.

    -Joey
    On Tue, Jun 7, 2011 at 6:31 PM, Zhong, Sheng wrote:
    Thanks! The issue has been resolved by removing some bad blks...

    But St.Ack,

    We do want a upgrade, and am starting the research. Pl help to provide
    your suggestion or comments:

    If we stick with apache version, the latest stable version is
    hadoop-0.20.203.0rc1.tar.gz. However, it may have potentially compatible
    issue with latest Hbase 0.90.2 according to Michel Noll, specified from
    http://www.michael-noll.com/blog/2011/04/14/building-an-hadoop-0-20-x-ve
    rsion-for-hbase-0-90-2/comment-page-1/#comment-19757:
    "As of today, Hadoop 0.20.2 is the latest stable release of Apache
    Hadoop that is marked as ready for production (neither 0.21 nor 0.22
    are). Unfortunately, Hadoop 0.20.2 release is not compatible with the
    latest stable version of HBase:" The paper suggests either uses
    branch-0.20-append or use hadoop jar found from HBASE.

    Andy


    -----Original Message-----
    From: saint.ack@gmail.com On Behalf Of
    Stack
    Sent: Tuesday, June 07, 2011 5:13 PM
    To: common-user@hadoop.apache.org
    Subject: Re: Hbase startup error: NoNode for /hbase/master after running
    out of space
    On Mon, Jun 6, 2011 at 8:29 PM, Zhong, Sheng wrote:
    I am appreciated by any help and suggestion. P.S: we're using apache
    hadoop 0.20.2 and hbase 0.20.3, and zookeeper is running via
    zookeeper-3.2.2 (not managed by Hbase).
    Can you upgrade you hbase and hadoop?
    St.Ack


    --
    Joseph Echeverria
    Cloudera, Inc.
    443.305.9434

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedJun 7, '11 at 3:30a
activeJun 8, '11 at 11:18p
posts4
users3
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase