FAQ
Tools to inject blocks into name node and simulated data nodes for testing
--------------------------------------------------------------------------

Key: HADOOP-3577
URL: https://issues.apache.org/jira/browse/HADOOP-3577
Project: Hadoop Core
Issue Type: Improvement
Components: dfs
Reporter: Sanjay Radia
Assignee: Sanjay Radia
Priority: Minor
Fix For: 0.19.0


This jira adds the following 2 features to src/test
1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.

Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Sanjay Radia (JIRA) at Jun 17, 2008 at 4:54 am
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Sanjay Radia updated HADOOP-3577:
    ---------------------------------

    Attachment: inject.patch
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Sanjay Radia (JIRA) at Jun 18, 2008 at 10:50 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Sanjay Radia updated HADOOP-3577:
    ---------------------------------

    Attachment: inject2.patch

    Update patch with some improvements to CreateEditsLog
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Lohit Vijayarenu (JIRA) at Jun 20, 2008 at 10:46 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12606925#action_12606925 ]

    Lohit Vijayarenu commented on HADOOP-3577:
    ------------------------------------------

    +1 on this initial version. I think we should get this into the source tree and add more improvements in other JIRAs. I tested this tool to simulate DataNodes and works great.
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Lohit Vijayarenu (JIRA) at Jun 20, 2008 at 10:46 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Lohit Vijayarenu updated HADOOP-3577:
    -------------------------------------

    Hadoop Flags: [Reviewed]
    Status: Patch Available (was: Open)
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Jun 21, 2008 at 1:42 am
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12606958#action_12606958 ]

    Tsz Wo (Nicholas), SZE commented on HADOOP-3577:
    ------------------------------------------------

    Need license header for the new file CreateEditsLog.java.
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Jun 21, 2008 at 4:16 am
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12606968#action_12606968 ]

    Hadoop QA commented on HADOOP-3577:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12384240/inject2.patch
    against trunk revision 670086.

    +1 @author. The patch does not contain any @author tags.

    +1 tests included. The patch appears to include 15 new or modified tests.

    +1 javadoc. The javadoc tool did not generate any warning messages.

    +1 javac. The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs. The patch does not introduce any new Findbugs warnings.

    -1 release audit. The applied patch generated 207 release audit warnings (more than the trunk's current 206 warnings).

    +1 core tests. The patch passed core unit tests.

    +1 contrib tests. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2714/testReport/
    Release audit warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2714/artifact/trunk/current/releaseAuditDiffWarnings.txt
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2714/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2714/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2714/console

    This message is automatically generated.
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Lohit Vijayarenu (JIRA) at Jun 23, 2008 at 7:03 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Lohit Vijayarenu updated HADOOP-3577:
    -------------------------------------

    Attachment: inject3.patch

    Attached file adds Apache header for the new file CreateEditsLog
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch, inject3.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Lohit Vijayarenu (JIRA) at Jun 23, 2008 at 7:05 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607347#action_12607347 ]

    Lohit Vijayarenu commented on HADOOP-3577:
    ------------------------------------------

    test-patch result on my local box
    [exec] +1 overall.
    [exec]
    [exec] +1 @author. The patch does not contain any @author tags.
    [exec]
    [exec] +1 tests included. The patch appears to include 15 new or modified tests.
    [exec]
    [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
    [exec]
    [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
    [exec]
    [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
    [exec]

    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch, inject3.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hairong Kuang (JIRA) at Jun 23, 2008 at 11:14 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Hairong Kuang updated HADOOP-3577:
    ----------------------------------

    Resolution: Fixed
    Status: Resolved (was: Patch Available)

    I've just committed this. Thanks, Sanjay!
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch, inject3.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Jun 24, 2008 at 12:27 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607598#action_12607598 ]

    Hudson commented on HADOOP-3577:
    --------------------------------

    Integrated in Hadoop-trunk #528 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/528/])
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch, inject3.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Jun 25, 2008 at 12:38 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608019#action_12608019 ]

    Hudson commented on HADOOP-3577:
    --------------------------------

    Integrated in Hadoop-trunk #529 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/529/])
    Tools to inject blocks into name node and simulated data nodes for testing
    --------------------------------------------------------------------------

    Key: HADOOP-3577
    URL: https://issues.apache.org/jira/browse/HADOOP-3577
    Project: Hadoop Core
    Issue Type: Improvement
    Components: dfs
    Reporter: Sanjay Radia
    Assignee: Sanjay Radia
    Priority: Minor
    Fix For: 0.19.0

    Attachments: inject.patch, inject2.patch, inject3.patch


    This jira adds the following 2 features to src/test
    1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
    2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.
    Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJun 17, '08 at 4:50a
activeJun 25, '08 at 12:38p
posts12
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 12 posts

People

Translate

site design / logo © 2022 Grokbase