Grokbase Groups HBase user July 2010
FAQ
Thanks for the answer.

GC pause seems to be a major cause for region server to come down:
2010-07-21 09:07:14,138 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
291505ms, ten times longer than scheduled: 10000

Is it possible for HBase Master to restart dead region server in this case ?
On Wed, Jul 21, 2010 at 10:02 AM, Jean-Daniel Cryans wrote:

HBaseAdmin.getClusterStatus().getServers()

J-D
On Wed, Jul 21, 2010 at 9:56 AM, Ted Yu wrote:
Hi,
Is there API to query the number of live region servers ?

Thanks

Search Discussions

  • Jean-Daniel Cryans at Jul 21, 2010 at 5:32 pm
    The stance in the hbase dev community on that issue is to let users'
    cluster management tools handle it.

    Also, how would you start a java process on a remote machine (if still
    alive) from another java process (the master)? If you can find an
    elegant way that doesn't rely on SSH, this would be a nice
    contribution that users could enable.

    J-D
    On Wed, Jul 21, 2010 at 10:25 AM, Ted Yu wrote:
    Thanks for the answer.

    GC pause seems to be a major cause for region server to come down:
    2010-07-21 09:07:14,138 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
    291505ms, ten times longer than scheduled: 10000

    Is it possible for HBase Master to restart dead region server in this case ?
    On Wed, Jul 21, 2010 at 10:02 AM, Jean-Daniel Cryans wrote:

    HBaseAdmin.getClusterStatus().getServers()

    J-D
    On Wed, Jul 21, 2010 at 9:56 AM, Ted Yu wrote:
    Hi,
    Is there API to query the number of live region servers ?

    Thanks
  • Ted Yu at Jul 21, 2010 at 5:42 pm
    J-D:
    Can you elaborate why ssh isn't preferred ?

    One solution is to create a light weight Java process that monitors region
    server log and perform this duty.
    On Wed, Jul 21, 2010 at 10:31 AM, Jean-Daniel Cryans wrote:

    The stance in the hbase dev community on that issue is to let users'
    cluster management tools handle it.

    Also, how would you start a java process on a remote machine (if still
    alive) from another java process (the master)? If you can find an
    elegant way that doesn't rely on SSH, this would be a nice
    contribution that users could enable.

    J-D
    On Wed, Jul 21, 2010 at 10:25 AM, Ted Yu wrote:
    Thanks for the answer.

    GC pause seems to be a major cause for region server to come down:
    2010-07-21 09:07:14,138 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
    291505ms, ten times longer than scheduled: 10000

    Is it possible for HBase Master to restart dead region server in this case ?
    On Wed, Jul 21, 2010 at 10:02 AM, Jean-Daniel Cryans <
    jdcryans@apache.org>wrote:
    HBaseAdmin.getClusterStatus().getServers()

    J-D
    On Wed, Jul 21, 2010 at 9:56 AM, Ted Yu wrote:
    Hi,
    Is there API to query the number of live region servers ?

    Thanks
  • Edward Capriolo at Jul 21, 2010 at 5:45 pm

    On Wed, Jul 21, 2010 at 1:40 PM, Ted Yu wrote:
    J-D:
    Can you elaborate why ssh isn't preferred ?

    One solution is to create a light weight Java process that monitors region
    server log and perform this duty.
    On Wed, Jul 21, 2010 at 10:31 AM, Jean-Daniel Cryans wrote:

    The stance in the hbase dev community on that issue is to let users'
    cluster management tools handle it.

    Also, how would you start a java process on a remote machine (if still
    alive) from another java process (the master)? If you can find an
    elegant way that doesn't rely on SSH, this would be a nice
    contribution that users could enable.

    J-D
    On Wed, Jul 21, 2010 at 10:25 AM, Ted Yu wrote:
    Thanks for the answer.

    GC pause seems to be a major cause for region server to come down:
    2010-07-21 09:07:14,138 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
    291505ms, ten times longer than scheduled: 10000

    Is it possible for HBase Master to restart dead region server in this case ?
    On Wed, Jul 21, 2010 at 10:02 AM, Jean-Daniel Cryans <
    jdcryans@apache.org>wrote:
    HBaseAdmin.getClusterStatus().getServers()

    J-D
    On Wed, Jul 21, 2010 at 9:56 AM, Ted Yu wrote:
    Hi,
    Is there API to query the number of live region servers ?

    Thanks
    Ted,
    I just wrote to very relevant articles in my blog

    Using func instead of SSH keys
    http://www.edwardcapriolo.com/roller/edwardcapriolo/entry/func_hadoop_the_end_of

    http://www.edwardcapriolo.com/roller/edwardcapriolo/entry/hadoop_secondarynamenode_puppet

    In which I use the puppet 'service resource' to do automatic restarts
    of a secondary namenode. You could use puppet to accomplish auto
    restarts for a region server.

    I usually tweet my new recipes when I come out with
    themhttp://twitter.com/@edwardcapriolo
  • Ted Yu at Jul 21, 2010 at 5:51 pm
    I personally think a self-healing HBase is what every HBase user expects.
    On Wed, Jul 21, 2010 at 10:44 AM, Edward Capriolo wrote:
    On Wed, Jul 21, 2010 at 1:40 PM, Ted Yu wrote:
    J-D:
    Can you elaborate why ssh isn't preferred ?

    One solution is to create a light weight Java process that monitors region
    server log and perform this duty.

    On Wed, Jul 21, 2010 at 10:31 AM, Jean-Daniel Cryans <
    jdcryans@apache.org>wrote:
    The stance in the hbase dev community on that issue is to let users'
    cluster management tools handle it.

    Also, how would you start a java process on a remote machine (if still
    alive) from another java process (the master)? If you can find an
    elegant way that doesn't rely on SSH, this would be a nice
    contribution that users could enable.

    J-D
    On Wed, Jul 21, 2010 at 10:25 AM, Ted Yu wrote:
    Thanks for the answer.

    GC pause seems to be a major cause for region server to come down:
    2010-07-21 09:07:14,138 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
    291505ms, ten times longer than scheduled: 10000

    Is it possible for HBase Master to restart dead region server in this case ?
    On Wed, Jul 21, 2010 at 10:02 AM, Jean-Daniel Cryans <
    jdcryans@apache.org>wrote:
    HBaseAdmin.getClusterStatus().getServers()

    J-D
    On Wed, Jul 21, 2010 at 9:56 AM, Ted Yu wrote:
    Hi,
    Is there API to query the number of live region servers ?

    Thanks
    Ted,
    I just wrote to very relevant articles in my blog

    Using func instead of SSH keys

    http://www.edwardcapriolo.com/roller/edwardcapriolo/entry/func_hadoop_the_end_of


    http://www.edwardcapriolo.com/roller/edwardcapriolo/entry/hadoop_secondarynamenode_puppet

    In which I use the puppet 'service resource' to do automatic restarts
    of a secondary namenode. You could use puppet to accomplish auto
    restarts for a region server.

    I usually tweet my new recipes when I come out with
    themhttp://twitter.com/@edwardcapriolo

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshbase, hadoop
postedJul 21, '10 at 5:25p
activeJul 21, '10 at 5:51p
posts5
users3
websitehbase.apache.org

People

Translate

site design / logo © 2022 Grokbase