FAQ
HDFS 20 append: Lightweight NameNode operations to trigger lease recovery
-------------------------------------------------------------------------

Key: HDFS-1520
URL: https://issues.apache.org/jira/browse/HDFS-1520
Project: Hadoop HDFS
Issue Type: New Feature
Affects Versions: 0.20-append
Reporter: Hairong Kuang
Assignee: Hairong Kuang
Fix For: 0.20-append


Currently HBase uses append to trigger the close of HLog during Hlog split. Append is a very expensive operation, which involves not only NameNode operations but creating a writing pipeline. If one of datanodes on the pipeline has a problem, this recovery may takes minutes. I'd like implement a lightweight NameNode operation to trigger lease recovery and make HBase to use this instead.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • dhruba borthakur (JIRA) at Dec 10, 2010 at 5:41 am
    [ https://issues.apache.org/jira/browse/HDFS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur resolved HDFS-1520.
    ------------------------------------

    Resolution: Fixed
    Hadoop Flags: [Reviewed]

    I just committed this. Thanks Hairong!
    HDFS 20 append: Lightweight NameNode operation to trigger lease recovery
    ------------------------------------------------------------------------

    Key: HDFS-1520
    URL: https://issues.apache.org/jira/browse/HDFS-1520
    Project: Hadoop HDFS
    Issue Type: New Feature
    Affects Versions: 0.20-append
    Reporter: Hairong Kuang
    Assignee: Hairong Kuang
    Fix For: 0.20-append

    Attachments: recoverLeaseApache20.patch


    Currently HBase uses append to trigger the close of HLog during Hlog split. Append is a very expensive operation, which involves not only NameNode operations but creating a writing pipeline. If one of datanodes on the pipeline has a problem, this recovery may takes minutes. I'd like implement a lightweight NameNode operation to trigger lease recovery and make HBase to use this instead.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
categorieshadoop
postedNov 29, '10 at 9:32p
activeDec 10, '10 at 5:41a
posts2
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

dhruba borthakur (JIRA): 2 posts

People

Translate

site design / logo © 2022 Grokbase