FAQ
DFSClient should track failures by block rather than globally
-------------------------------------------------------------

Key: HADOOP-3185
URL: https://issues.apache.org/jira/browse/HADOOP-3185
Project: Hadoop Core
Issue Type: Improvement
Reporter: Chris Douglas
Fix For: 0.18.0


Rather than tracking the total number of times DFSInputStream failed to locate a datanode for a particular block, such failures and the the list of datanodes involved should be scoped to individual blocks. In particular, the "deadnode" list should be a map of blocks to a list of failed nodes, the latter reset and the nodes retried per the existing semantics.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • dhruba borthakur (JIRA) at Apr 7, 2008 at 7:03 am
    [ https://issues.apache.org/jira/browse/HADOOP-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3185:
    -------------------------------------

    Component/s: dfs
    DFSClient should track failures by block rather than globally
    -------------------------------------------------------------

    Key: HADOOP-3185
    URL: https://issues.apache.org/jira/browse/HADOOP-3185
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Chris Douglas
    Fix For: 0.18.0


    Rather than tracking the total number of times DFSInputStream failed to locate a datanode for a particular block, such failures and the the list of datanodes involved should be scoped to individual blocks. In particular, the "deadnode" list should be a map of blocks to a list of failed nodes, the latter reset and the nodes retried per the existing semantics.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Mukund Madhugiri (JIRA) at Jun 7, 2008 at 1:27 am
    [ https://issues.apache.org/jira/browse/HADOOP-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mukund Madhugiri updated HADOOP-3185:
    -------------------------------------

    Fix Version/s: (was: 0.18.0)
    DFSClient should track failures by block rather than globally
    -------------------------------------------------------------

    Key: HADOOP-3185
    URL: https://issues.apache.org/jira/browse/HADOOP-3185
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Chris Douglas

    Rather than tracking the total number of times DFSInputStream failed to locate a datanode for a particular block, such failures and the the list of datanodes involved should be scoped to individual blocks. In particular, the "deadnode" list should be a map of blocks to a list of failed nodes, the latter reset and the nodes retried per the existing semantics.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedApr 4, '08 at 11:42p
activeJun 7, '08 at 1:27a
posts3
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Mukund Madhugiri (JIRA): 3 posts

People

Translate

site design / logo © 2022 Grokbase