FAQ
HDFS 20 append: Disallow pipeline recovery if a file is already being lease recovered
-------------------------------------------------------------------------------------

Key: HDFS-1555
URL: https://issues.apache.org/jira/browse/HDFS-1555
Project: Hadoop HDFS
Issue Type: Improvement
Affects Versions: 0.20-append
Reporter: Hairong Kuang
Assignee: Hairong Kuang
Fix For: 0.20-append


When a file is under lease recovery and the writer is still alive, the write pipeline will be killed and then the writer will start a pipeline recovery. Sometimes the pipeline recovery may race before the lease recovery and as a result fail the lease recovery. This is very bad if we want to support the strong recoverLease semantics in HDFS-1554. So it would be nice if we could disallow a file's pipeline recovery while its lease recovery is in progress.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Hairong Kuang (JIRA) at Jan 7, 2011 at 8:30 pm
    [ https://issues.apache.org/jira/browse/HDFS-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Hairong Kuang resolved HDFS-1555.
    ---------------------------------

    Resolution: Fixed
    Hadoop Flags: [Reviewed]

    I just committed this!
    HDFS 20 append: Disallow pipeline recovery if a file is already being lease recovered
    -------------------------------------------------------------------------------------

    Key: HDFS-1555
    URL: https://issues.apache.org/jira/browse/HDFS-1555
    Project: Hadoop HDFS
    Issue Type: Improvement
    Affects Versions: 0.20-append
    Reporter: Hairong Kuang
    Assignee: Hairong Kuang
    Fix For: 0.20-append

    Attachments: appendRecoveryRace.patch, recoveryRace.patch


    When a file is under lease recovery and the writer is still alive, the write pipeline will be killed and then the writer will start a pipeline recovery. Sometimes the pipeline recovery may race before the lease recovery and as a result fail the lease recovery. This is very bad if we want to support the strong recoverLease semantics in HDFS-1554. So it would be nice if we could disallow a file's pipeline recovery while its lease recovery is in progress.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
categorieshadoop
postedDec 22, '10 at 11:35p
activeJan 7, '11 at 8:30p
posts2
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hairong Kuang (JIRA): 2 posts

People

Translate

site design / logo © 2022 Grokbase