Grokbase Groups HBase dev July 2009
FAQ
Set status for rowcounter
-------------------------

Key: HBASE-1701
URL: https://issues.apache.org/jira/browse/HBASE-1701
Project: Hadoop HBase
Issue Type: Improvement
Reporter: stack
Priority: Trivial


Set some status on rowcounter.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • stack (JIRA) at Jul 24, 2009 at 4:58 pm
    [ https://issues.apache.org/jira/browse/HBASE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735096#action_12735096 ]

    stack commented on HBASE-1701:
    ------------------------------

    Our rowcounter mapreduce job currently shows no progress and does not set status. Shouldn't be too hard having it guess progress made doing rough BigDecimal on region start/end.

    I did this which at least adds some status but I think it might have slowed rowcounter -- check:

    {code}
    Index: src/java/org/apache/hadoop/hbase/mapreduce/RowCounter.java
    ===================================================================
    --- src/java/org/apache/hadoop/hbase/mapreduce/RowCounter.java (revision 797250)
    +++ src/java/org/apache/hadoop/hbase/mapreduce/RowCounter.java (working copy)
    @@ -47,8 +47,11 @@
    static class RowCounterMapper
    extends TableMapper<ImmutableBytesWritable, Result> {

    - /** Counter enumeration to count the actual rows. */
    + /* Counter enumeration to count the actual rows. */
    private static enum Counters { ROWS }
    +
    + /* Local counter for this map. */
    + private long counter = 0;

    /**
    * Maps the data.
    @@ -67,6 +70,7 @@
    for (KeyValue value: values.list()) {
    if (value.getValue().length > 0) {
    context.getCounter(Counters.ROWS).increment(1);
    + context.setStatus("" + counter++);
    break;
    }
    }
    {code}
    Set status for rowcounter
    -------------------------

    Key: HBASE-1701
    URL: https://issues.apache.org/jira/browse/HBASE-1701
    Project: Hadoop HBase
    Issue Type: Improvement
    Reporter: stack
    Priority: Trivial

    Set some status on rowcounter.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • stack (JIRA) at Jul 24, 2009 at 5:06 pm
    [ https://issues.apache.org/jira/browse/HBASE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    stack resolved HBASE-1701.
    --------------------------

    Resolution: Invalid

    This issue is too dumb to have a life. As jdcryans points out, lets just fix this all properly by addiing to TIF progress (we already have an issue for this).
    Set status for rowcounter
    -------------------------

    Key: HBASE-1701
    URL: https://issues.apache.org/jira/browse/HBASE-1701
    Project: Hadoop HBase
    Issue Type: Improvement
    Reporter: stack
    Priority: Trivial

    Set some status on rowcounter.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categorieshbase, hadoop
postedJul 24, '09 at 4:56p
activeJul 24, '09 at 5:06p
posts3
users1
websitehbase.apache.org

1 user in discussion

stack (JIRA): 3 posts

People

Translate

site design / logo © 2022 Grokbase