FAQ
No config parameter for initial block report detail sin Hadoop-defaults.xml
---------------------------------------------------------------------------

Key: HADOOP-3486
URL: https://issues.apache.org/jira/browse/HADOOP-3486
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Reporter: Sanjay Radia
Assignee: Sanjay Radia
Fix For: 0.18.0


HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
This Jira fixes that.
- conf/hadoop-defaults.xml uses a default value of 60 sec (as does the code)
- src/test/haddoop-sites uses a default value of 0 sec.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Sanjay Radia (JIRA) at Jun 3, 2008 at 7:31 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Sanjay Radia updated HADOOP-3486:
    ---------------------------------

    Attachment: hadoopDefaults4Delay.patch
    No config parameter for initial block report detail sin Hadoop-defaults.xml
    ---------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 60 sec (as does the code)
    - src/test/haddoop-sites uses a default value of 0 sec.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Jun 3, 2008 at 8:45 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602065#action_12602065 ]

    Owen O'Malley commented on HADOOP-3486:
    ---------------------------------------

    There is a reasonable case to be made for setting this to 0 secs in the default.

    In particular, now hdfs on a single node configuration takes much much longer to come up than before.


    No config parameter for initial block report detail sin Hadoop-defaults.xml
    ---------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 60 sec (as does the code)
    - src/test/haddoop-sites uses a default value of 0 sec.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Sanjay Radia (JIRA) at Jun 3, 2008 at 9:57 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602088#action_12602088 ]

    Sanjay Radia commented on HADOOP-3486:
    --------------------------------------

    Good case to make it shorter; do you literally mean 0 sec or something short like 5sec?
    I had set the default for common mid sized cluster (100-400 nodes).
    Looks like we should really do HADOOP-2444 which automates the backoff parameter.
    I guess the argument is that the person running the one node cluster needs to right default value and that only one running a larger cluster is smart enough to configure the
    appropriate delay parameter.
    No config parameter for initial block report detail sin Hadoop-defaults.xml
    ---------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 60 sec (as does the code)
    - src/test/haddoop-sites uses a default value of 0 sec.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Sanjay Radia (JIRA) at Jun 3, 2008 at 10:07 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Sanjay Radia updated HADOOP-3486:
    ---------------------------------

    Attachment: hadoopDefaults4Delay2.patch
    No config parameter for initial block report detail sin Hadoop-defaults.xml
    ---------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 60 sec (as does the code)
    - src/test/haddoop-sites uses a default value of 0 sec.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Sanjay Radia (JIRA) at Jun 3, 2008 at 10:09 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Sanjay Radia updated HADOOP-3486:
    ---------------------------------

    Description:
    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 0 sec (as does the code)

    was:
    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 60 sec (as does the code)
    - src/test/haddoop-sites uses a default value of 0 sec.

    Release Note: The default value from for initial block report changes from 60sec to 0sec.
    Hadoop Flags: [Incompatible change]
    No config parameter for initial block report detail sin Hadoop-defaults.xml
    ---------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 0 sec (as does the code)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Sanjay Radia (JIRA) at Jun 3, 2008 at 10:11 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Sanjay Radia updated HADOOP-3486:
    ---------------------------------

    Attachment: (was: hadoopDefaults4Delay2.patch)
    No config parameter for initial block report detail sin Hadoop-defaults.xml
    ---------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 0 sec (as does the code)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Sanjay Radia (JIRA) at Jun 3, 2008 at 10:15 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Sanjay Radia updated HADOOP-3486:
    ---------------------------------

    Attachment: hadoopDefaults4Delay2.patch
    No config parameter for initial block report detail sin Hadoop-defaults.xml
    ---------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 0 sec (as does the code)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Sanjay Radia (JIRA) at Jun 3, 2008 at 10:19 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Sanjay Radia updated HADOOP-3486:
    ---------------------------------

    Description:
    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.

    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml


    was:
    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration but this config parameter was not documented in the Hadoop-defaults.xml
    This Jira fixes that.
    - conf/hadoop-defaults.xml uses a default value of 0 sec (as does the code)

    Summary: Change default for initial block report to 0 sec and document it in hadoop-defaults.xml (was: No config parameter for initial block report detail sin Hadoop-defaults.xml)
    Change default for initial block report to 0 sec and document it in hadoop-defaults.xml
    ---------------------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.
    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Sanjay Radia (JIRA) at Jun 3, 2008 at 10:21 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602088#action_12602088 ]

    sanjay.radia edited comment on HADOOP-3486 at 6/3/08 3:19 PM:
    --------------------------------------------------------------


    I had set the default for common mid sized cluster (100-400 nodes).
    Looks like we should really do HADOOP-2444 which automates the backoff parameter.
    I guess the argument is that the person running the one node cluster needs to right default value and that only one running a larger cluster is smart enough to configure the
    appropriate delay parameter.

    Jira description and patch has been updated to set the default to 0.

    was (Author: sanjay.radia):
    Good case to make it shorter; do you literally mean 0 sec or something short like 5sec?
    I had set the default for common mid sized cluster (100-400 nodes).
    Looks like we should really do HADOOP-2444 which automates the backoff parameter.
    I guess the argument is that the person running the one node cluster needs to right default value and that only one running a larger cluster is smart enough to configure the
    appropriate delay parameter.
    Change default for initial block report to 0 sec and document it in hadoop-defaults.xml
    ---------------------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.
    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hairong Kuang (JIRA) at Jun 3, 2008 at 10:25 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Hairong Kuang updated HADOOP-3486:
    ----------------------------------

    Hadoop Flags: [Incompatible change, Reviewed] (was: [Incompatible change])
    Status: Patch Available (was: Open)
    Change default for initial block report to 0 sec and document it in hadoop-defaults.xml
    ---------------------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.
    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hairong Kuang (JIRA) at Jun 3, 2008 at 10:25 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602098#action_12602098 ]

    Hairong Kuang commented on HADOOP-3486:
    ---------------------------------------

    +1. The change looks good.
    Change default for initial block report to 0 sec and document it in hadoop-defaults.xml
    ---------------------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.
    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Jun 4, 2008 at 12:23 am
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602128#action_12602128 ]

    Hadoop QA commented on HADOOP-3486:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12383333/hadoopDefaults4Delay2.patch
    against trunk revision 662913.

    +1 @author. The patch does not contain any @author tags.

    -1 tests included. The patch doesn't appear to include any new or modified tests.
    Please justify why no tests are needed for this patch.

    -1 patch. The patch command could not apply the patch.

    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2559/console

    This message is automatically generated.
    Change default for initial block report to 0 sec and document it in hadoop-defaults.xml
    ---------------------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.
    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Jun 4, 2008 at 11:56 am
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602257#action_12602257 ]

    Hadoop QA commented on HADOOP-3486:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12383333/hadoopDefaults4Delay2.patch
    against trunk revision 662976.

    +1 @author. The patch does not contain any @author tags.

    -1 tests included. The patch doesn't appear to include any new or modified tests.
    Please justify why no tests are needed for this patch.

    +1 javadoc. The javadoc tool did not generate any warning messages.

    +1 javac. The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs. The patch does not introduce any new Findbugs warnings.

    +1 release audit. The applied patch does not increase the total number of release audit warnings.

    +1 core tests. The patch passed core unit tests.

    +1 contrib tests. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2568/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2568/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2568/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2568/console

    This message is automatically generated.
    Change default for initial block report to 0 sec and document it in hadoop-defaults.xml
    ---------------------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.
    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Jun 4, 2008 at 5:07 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3486:
    ----------------------------------

    Resolution: Fixed
    Hadoop Flags: [Incompatible change, Reviewed] (was: [Reviewed, Incompatible change])
    Status: Resolved (was: Patch Available)

    I just committed this. Thanks, Sanjay!
    Change default for initial block report to 0 sec and document it in hadoop-defaults.xml
    ---------------------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.
    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Robert Chansler (JIRA) at Jul 1, 2008 at 1:07 am
    [ https://issues.apache.org/jira/browse/HADOOP-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Robert Chansler updated HADOOP-3486:
    ------------------------------------

    Release Note: Changed the default value of dfs.blockreport.initialDelay to be 0 seconds. (was: The default value from for initial block report changes from 60sec to 0sec.)
    Hadoop Flags: [Incompatible change, Reviewed] (was: [Reviewed, Incompatible change])
    Change default for initial block report to 0 sec and document it in hadoop-defaults.xml
    ---------------------------------------------------------------------------------------

    Key: HADOOP-3486
    URL: https://issues.apache.org/jira/browse/HADOOP-3486
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Fix For: 0.18.0

    Attachments: hadoopDefaults4Delay.patch, hadoopDefaults4Delay2.patch


    HADOOP-2326 added a new config parameter for the initial block report that gets sent after DataNode registration.
    The default value for this parameter was 60 sec.
    This Jira changes the default to 0 sec - the approriate default for 1 node or small clusters (say less than 50 nodes)
    This Jira also documents the config parameter in hadoop-defaults.xml
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJun 3, '08 at 7:29p
activeJul 1, '08 at 1:07a
posts16
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Robert Chansler (JIRA): 16 posts

People

Translate

site design / logo © 2022 Grokbase