FAQ
FileSystems should track how many bytes are read and written
------------------------------------------------------------

Key: HADOOP-3001
URL: https://issues.apache.org/jira/browse/HADOOP-3001
Project: Hadoop Core
Issue Type: New Feature
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Fix For: 0.17.0


It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Owen O'Malley (JIRA) at Mar 20, 2008 at 10:25 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Status: Patch Available (was: Open)
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Fix For: 0.17.0

    Attachments: 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Mar 20, 2008 at 10:25 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Attachment: 3001.patch

    This patch extends the FileSystem to get a statistics object that it can use for update the number of bytes read and written by the client. Map/Reduce gets task counters that count the number of bytes read and written by HDFS, LocalRaw, S3, and KFS.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Fix For: 0.17.0

    Attachments: 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Mar 21, 2008 at 9:23 am
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581032#action_12581032 ]

    Hadoop QA commented on HADOOP-3001:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12378354/3001.patch
    against trunk revision 619744.

    @author +1. The patch does not contain any @author tags.

    tests included +1. The patch appears to include 51 new or modified tests.

    javadoc +1. The javadoc tool did not generate any warning messages.

    javac -1. The applied patch generated 579 javac compiler warnings (more than the trunk's current 575 warnings).

    release audit -1. The applied patch generated 198 release audit warnings (more than the trunk's current 197 warnings).

    findbugs -1. The patch appears to introduce 1 new Findbugs warnings.

    core tests -1. The patch failed core unit tests.

    contrib tests +1. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/artifact/trunk/build/test/checkstyle-errors.html
    Release audit warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/artifact/trunk/current/releaseAuditDiffWarnings.txt
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/console

    This message is automatically generated.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Fix For: 0.17.0

    Attachments: 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 2, 2008 at 11:02 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Status: Open (was: Patch Available)
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 2, 2008 at 11:02 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Attachment: 3001-2.patch

    I updated to trunk.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 2, 2008 at 11:03 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Release Note: Adds new framework map/reduce counters that track the number of bytes read and written to HDFS, local, KFS, and S3 file systems.
    Status: Patch Available (was: Open)
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 2, 2008 at 11:04 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Status: Open (was: Patch Available)
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 2, 2008 at 11:06 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Status: Patch Available (was: Open)
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 3, 2008 at 12:11 am
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Attachment: 3001-4.patch

    Removed a couple of unrelated changes that slipped in.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Apr 3, 2008 at 2:18 am
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584957#action_12584957 ]

    Hadoop QA commented on HADOOP-3001:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12379207/3001-4.patch
    against trunk revision 643282.

    @author +1. The patch does not contain any @author tags.

    tests included -1. The patch doesn't appear to include any new or modified tests.
    Please justify why no tests are needed for this patch.

    javadoc +1. The javadoc tool did not generate any warning messages.

    javac +1. The applied patch does not generate any new javac compiler warnings.

    release audit +1. The applied patch does not generate any new release audit warnings.

    findbugs +1. The patch does not introduce any new Findbugs warnings.

    core tests +1. The patch passed core unit tests.

    contrib tests +1. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2130/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2130/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2130/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2130/console

    This message is automatically generated.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Apr 3, 2008 at 5:02 am
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584985#action_12584985 ]

    Chris Douglas commented on HADOOP-3001:
    ---------------------------------------

    Only two minor nits, but neither is pressing:
    * It looks like you picked up a whitespace change to SequenceFileRecordReader
    * The FileSystem.Statistics objects can be {{final}}

    +1
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Apr 3, 2008 at 5:06 am
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Chris Douglas updated HADOOP-3001:
    ----------------------------------

    Hadoop Flags: [Incompatible change, Reviewed]
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 3, 2008 at 5:02 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Status: Open (was: Patch Available)
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 3, 2008 at 5:03 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Attachment: 3001-5.patch

    Added test case and removed spacing diff.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 3, 2008 at 5:03 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Hadoop Flags: [Incompatible change, Reviewed] (was: [Reviewed, Incompatible change])
    Status: Patch Available (was: Open)
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 3, 2008 at 11:33 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Attachment: 3001-6.patch

    added final as chris suggested.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Apr 4, 2008 at 2:33 am
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585374#action_12585374 ]

    Hadoop QA commented on HADOOP-3001:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12379335/3001-6.patch
    against trunk revision 643282.

    @author +1. The patch does not contain any @author tags.

    tests included +1. The patch appears to include 3 new or modified tests.

    javadoc +1. The javadoc tool did not generate any warning messages.

    javac +1. The applied patch does not generate any new javac compiler warnings.

    release audit -1. The applied patch generated 200 release audit warnings (more than the trunk's current 199 warnings).

    findbugs +1. The patch does not introduce any new Findbugs warnings.

    core tests +1. The patch passed core unit tests.

    contrib tests +1. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/artifact/trunk/build/test/checkstyle-errors.html
    Release audit warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/artifact/trunk/current/releaseAuditDiffWarnings.txt
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/console

    This message is automatically generated.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Apr 4, 2008 at 3:34 am
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-3001:
    ----------------------------------

    Resolution: Fixed
    Hadoop Flags: [Reviewed] (was: [Reviewed, Incompatible change])
    Status: Resolved (was: Patch Available)

    I just committed this.
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Apr 5, 2008 at 12:17 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585986#action_12585986 ]

    Hudson commented on HADOOP-3001:
    --------------------------------

    Integrated in Hadoop-trunk #451 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/451/])
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Nigel Daley (JIRA) at May 14, 2008 at 12:38 am
    [ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Nigel Daley updated HADOOP-3001:
    --------------------------------

    Component/s: fs
    FileSystems should track how many bytes are read and written
    ------------------------------------------------------------

    Key: HADOOP-3001
    URL: https://issues.apache.org/jira/browse/HADOOP-3001
    Project: Hadoop Core
    Issue Type: New Feature
    Components: fs
    Reporter: Owen O'Malley
    Assignee: Owen O'Malley
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch


    It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedMar 11, '08 at 10:18p
activeMay 14, '08 at 12:38a
posts21
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Nigel Daley (JIRA): 21 posts

People

Translate

site design / logo © 2022 Grokbase