FAQ
Hi All,

I have 2 node cluster. When I create a table or insert a record, it used
write it in both datanodes on node1 and node2.

Suddenly, Hbase writes in only one datanode of node1.
When try to look for replication parameter in Cloudera manager, there is
nothing like that.

Any thoughts on this please?

Thanks

Search Discussions

  • Mike at Mar 19, 2013 at 12:34 am
    Could you please respond?
    On Thursday, March 14, 2013 3:07:44 PM UTC-4, Mike wrote:

    Hi All,

    I have 2 node cluster. When I create a table or insert a record, it used
    write it in both datanodes on node1 and node2.

    Suddenly, Hbase writes in only one datanode of node1.
    When try to look for replication parameter in Cloudera manager, there is
    nothing like that.

    Any thoughts on this please?

    Thanks
  • Harsh J at Mar 19, 2013 at 1:04 am
    Are you talking of HDFS replication or the HBase's own event replication?

    Also, you may want to ask CDH specific questions at
    cdh-user@cloudera.org lists instead of the SCM lists which is for CM
    questions and has such an audience.
    On Tue, Mar 19, 2013 at 6:04 AM, Mike wrote:
    Could you please respond?

    On Thursday, March 14, 2013 3:07:44 PM UTC-4, Mike wrote:

    Hi All,

    I have 2 node cluster. When I create a table or insert a record, it used
    write it in both datanodes on node1 and node2.

    Suddenly, Hbase writes in only one datanode of node1.
    When try to look for replication parameter in Cloudera manager, there is
    nothing like that.

    Any thoughts on this please?

    Thanks


    --
    Harsh J
  • Mike at Mar 19, 2013 at 2:59 am
    Earlier, in Hbase, if I created a table, it used to create it in 2
    nodes.(Ours is 2 node cluster).
    Now it does not do that.

    Thanks for you help!

    On Monday, March 18, 2013 9:04:09 PM UTC-4, Harsh J wrote:

    Are you talking of HDFS replication or the HBase's own event replication?

    Also, you may want to ask CDH specific questions at
    cdh-...@cloudera.org <javascript:> lists instead of the SCM lists which
    is for CM
    questions and has such an audience.

    On Tue, Mar 19, 2013 at 6:04 AM, Mike <mike...@gmail.com <javascript:>>
    wrote:
    Could you please respond?

    On Thursday, March 14, 2013 3:07:44 PM UTC-4, Mike wrote:

    Hi All,

    I have 2 node cluster. When I create a table or insert a record, it
    used
    write it in both datanodes on node1 and node2.

    Suddenly, Hbase writes in only one datanode of node1.
    When try to look for replication parameter in Cloudera manager, there
    is
    nothing like that.

    Any thoughts on this please?

    Thanks


    --
    Harsh J
  • Harsh J at Mar 19, 2013 at 5:06 am
    What do you mean by that exactly? Are you seeing it not replicate data
    across datanodes (how are you noticing that, fsck?) or something else
    in terms of 1 region vs. 2 regions?
    On Tue, Mar 19, 2013 at 8:29 AM, Mike wrote:
    Earlier, in Hbase, if I created a table, it used to create it in 2
    nodes.(Ours is 2 node cluster).
    Now it does not do that.

    Thanks for you help!

    On Monday, March 18, 2013 9:04:09 PM UTC-4, Harsh J wrote:

    Are you talking of HDFS replication or the HBase's own event replication?

    Also, you may want to ask CDH specific questions at
    cdh-...@cloudera.org lists instead of the SCM lists which is for CM
    questions and has such an audience.
    On Tue, Mar 19, 2013 at 6:04 AM, Mike wrote:
    Could you please respond?

    On Thursday, March 14, 2013 3:07:44 PM UTC-4, Mike wrote:

    Hi All,

    I have 2 node cluster. When I create a table or insert a record, it
    used
    write it in both datanodes on node1 and node2.

    Suddenly, Hbase writes in only one datanode of node1.
    When try to look for replication parameter in Cloudera manager, there
    is
    nothing like that.

    Any thoughts on this please?

    Thanks


    --
    Harsh J


    --
    Harsh J
  • Mike at Mar 19, 2013 at 1:59 pm
    It does not replicate across datanotes.
    I have 2 nodes in my cluster.
    Namenode and Regionserver1 is in node1 and regionserver2 is in node2.

    Using the Cloudera Manager, I click on
    hbase service -> regionserver1 -> Hbase region server web UI
    (http://mynode1:60030/rs-status)

    I do not see my table.

    Repeat the same steps for node 2
    hbase service -> regionserver1 -> Hbase region server web UI
    (http://mynode2:60030/rs-status)

    I see my table.

    Also, using the CM, when I click on hosts, I see node1 and node2. The disk
    space used by node1 is 28GB and node 2 is 12GB.
    The sizes of both used to be almost same.

    I noticed that balancer service is not running. Replication problem is
    because of that.

    Thanks


    On Tuesday, March 19, 2013 1:06:12 AM UTC-4, Harsh J wrote:

    What do you mean by that exactly? Are you seeing it not replicate data
    across datanodes (how are you noticing that, fsck?) or something else
    in terms of 1 region vs. 2 regions?

    On Tue, Mar 19, 2013 at 8:29 AM, Mike <mike...@gmail.com <javascript:>>
    wrote:
    Earlier, in Hbase, if I created a table, it used to create it in 2
    nodes.(Ours is 2 node cluster).
    Now it does not do that.

    Thanks for you help!

    On Monday, March 18, 2013 9:04:09 PM UTC-4, Harsh J wrote:

    Are you talking of HDFS replication or the HBase's own event
    replication?
    Also, you may want to ask CDH specific questions at
    cdh-...@cloudera.org lists instead of the SCM lists which is for CM
    questions and has such an audience.
    On Tue, Mar 19, 2013 at 6:04 AM, Mike wrote:
    Could you please respond?

    On Thursday, March 14, 2013 3:07:44 PM UTC-4, Mike wrote:

    Hi All,

    I have 2 node cluster. When I create a table or insert a record, it
    used
    write it in both datanodes on node1 and node2.

    Suddenly, Hbase writes in only one datanode of node1.
    When try to look for replication parameter in Cloudera manager,
    there
    is
    nothing like that.

    Any thoughts on this please?

    Thanks


    --
    Harsh J


    --
    Harsh J
  • Harsh J at Mar 19, 2013 at 3:15 pm
    Hi Mike,

    HBase's regions and blocks it uses on HDFS are two wholly different
    concepts - do not confuse between the two.

    Tables will be shown on the Master web UI of HBase alone. On
    RegionServer Web UIs, you see only regions that belong to a certain
    table. If you have just one region in your table then only one
    regionserver can serve it and it would alone show it up when you
    check. If you want this to be "2", then you have to split the region
    appropriately such that there are more than 1 region in your table and
    each is served by HBase's balancer from an individual RS. The regions
    have nothing to do with the underlying HDFS block replication for
    data, which is still handled fine.
    On Tue, Mar 19, 2013 at 7:28 PM, Mike wrote:
    It does not replicate across datanotes.
    I have 2 nodes in my cluster.
    Namenode and Regionserver1 is in node1 and regionserver2 is in node2.

    Using the Cloudera Manager, I click on
    hbase service -> regionserver1 -> Hbase region server web UI
    (http://mynode1:60030/rs-status)

    I do not see my table.

    Repeat the same steps for node 2
    hbase service -> regionserver1 -> Hbase region server web UI
    (http://mynode2:60030/rs-status)

    I see my table.

    Also, using the CM, when I click on hosts, I see node1 and node2. The disk
    space used by node1 is 28GB and node 2 is 12GB.
    The sizes of both used to be almost same.

    I noticed that balancer service is not running. Replication problem is
    because of that.

    Thanks


    On Tuesday, March 19, 2013 1:06:12 AM UTC-4, Harsh J wrote:

    What do you mean by that exactly? Are you seeing it not replicate data
    across datanodes (how are you noticing that, fsck?) or something else
    in terms of 1 region vs. 2 regions?
    On Tue, Mar 19, 2013 at 8:29 AM, Mike wrote:
    Earlier, in Hbase, if I created a table, it used to create it in 2
    nodes.(Ours is 2 node cluster).
    Now it does not do that.

    Thanks for you help!

    On Monday, March 18, 2013 9:04:09 PM UTC-4, Harsh J wrote:

    Are you talking of HDFS replication or the HBase's own event
    replication?

    Also, you may want to ask CDH specific questions at
    cdh-...@cloudera.org lists instead of the SCM lists which is for CM
    questions and has such an audience.
    On Tue, Mar 19, 2013 at 6:04 AM, Mike wrote:
    Could you please respond?

    On Thursday, March 14, 2013 3:07:44 PM UTC-4, Mike wrote:

    Hi All,

    I have 2 node cluster. When I create a table or insert a record, it
    used
    write it in both datanodes on node1 and node2.

    Suddenly, Hbase writes in only one datanode of node1.
    When try to look for replication parameter in Cloudera manager,
    there
    is
    nothing like that.

    Any thoughts on this please?

    Thanks


    --
    Harsh J


    --
    Harsh J


    --
    Harsh J

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedMar 14, '13 at 7:07p
activeMar 19, '13 at 3:15p
posts7
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Mike: 4 posts Harsh J: 3 posts

People

Translate

site design / logo © 2022 Grokbase