FAQ
Archvies sometimes create empty part files.
-------------------------------------------

Key: HADOOP-3560
URL: https://issues.apache.org/jira/browse/HADOOP-3560
Project: Hadoop Core
Issue Type: Bug
Reporter: Mahadev konar
Assignee: Mahadev konar
Priority: Blocker
Fix For: 0.18.0, 0.19.0


Archvies creates a bunch of empty part files sometimes which are not necessary.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Mahadev konar (JIRA) at Jun 13, 2008 at 10:36 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mahadev konar updated HADOOP-3560:
    ----------------------------------

    Attachment: hadoop-3560_1.patch

    this patch fixes the splits created in archive map reduce jobs so that splits are evenly distributed amongst the maps. The sync marker made the splits to be non uniform amongst the maps. The sync marker is called on each record append in the filesplits file.
    Archvies sometimes create empty part files.
    -------------------------------------------

    Key: HADOOP-3560
    URL: https://issues.apache.org/jira/browse/HADOOP-3560
    Project: Hadoop Core
    Issue Type: Bug
    Reporter: Mahadev konar
    Assignee: Mahadev konar
    Priority: Blocker
    Fix For: 0.18.0, 0.19.0

    Attachments: hadoop-3560_1.patch


    Archvies creates a bunch of empty part files sometimes which are not necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Mahadev konar (JIRA) at Jun 13, 2008 at 10:38 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mahadev konar updated HADOOP-3560:
    ----------------------------------

    Status: Patch Available (was: Open)
    Archvies sometimes create empty part files.
    -------------------------------------------

    Key: HADOOP-3560
    URL: https://issues.apache.org/jira/browse/HADOOP-3560
    Project: Hadoop Core
    Issue Type: Bug
    Reporter: Mahadev konar
    Assignee: Mahadev konar
    Priority: Blocker
    Fix For: 0.18.0, 0.19.0

    Attachments: hadoop-3560_1.patch


    Archvies creates a bunch of empty part files sometimes which are not necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Jun 14, 2008 at 1:06 am
    [ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605023#action_12605023 ]

    Hadoop QA commented on HADOOP-3560:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12383998/hadoop-3560_1.patch
    against trunk revision 667506.

    +1 @author. The patch does not contain any @author tags.

    -1 tests included. The patch doesn't appear to include any new or modified tests.
    Please justify why no tests are needed for this patch.

    +1 javadoc. The javadoc tool did not generate any warning messages.

    +1 javac. The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs. The patch does not introduce any new Findbugs warnings.

    +1 release audit. The applied patch does not increase the total number of release audit warnings.

    +1 core tests. The patch passed core unit tests.

    +1 contrib tests. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2658/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2658/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2658/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2658/console

    This message is automatically generated.
    Archvies sometimes create empty part files.
    -------------------------------------------

    Key: HADOOP-3560
    URL: https://issues.apache.org/jira/browse/HADOOP-3560
    Project: Hadoop Core
    Issue Type: Bug
    Reporter: Mahadev konar
    Assignee: Mahadev konar
    Priority: Blocker
    Fix For: 0.18.0, 0.19.0

    Attachments: hadoop-3560_1.patch


    Archvies creates a bunch of empty part files sometimes which are not necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Amareshwari Sriramadasu (JIRA) at Jun 16, 2008 at 5:12 am
    [ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Amareshwari Sriramadasu updated HADOOP-3560:
    --------------------------------------------

    Component/s: tools/harchive
    Archvies sometimes create empty part files.
    -------------------------------------------

    Key: HADOOP-3560
    URL: https://issues.apache.org/jira/browse/HADOOP-3560
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/harchive
    Reporter: Mahadev konar
    Assignee: Mahadev konar
    Priority: Blocker
    Fix For: 0.18.0, 0.19.0

    Attachments: hadoop-3560_1.patch


    Archvies creates a bunch of empty part files sometimes which are not necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Mahadev konar (JIRA) at Jun 16, 2008 at 8:04 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605398#action_12605398 ]

    Mahadev konar commented on HADOOP-3560:
    ---------------------------------------

    i have not added tests since the test require creation of large input files.
    Archvies sometimes create empty part files.
    -------------------------------------------

    Key: HADOOP-3560
    URL: https://issues.apache.org/jira/browse/HADOOP-3560
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/harchive
    Reporter: Mahadev konar
    Assignee: Mahadev konar
    Priority: Blocker
    Fix For: 0.18.0, 0.19.0

    Attachments: hadoop-3560_1.patch


    Archvies creates a bunch of empty part files sometimes which are not necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Devaraj Das (JIRA) at Jun 17, 2008 at 5:16 am
    [ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Devaraj Das updated HADOOP-3560:
    --------------------------------

    Resolution: Fixed
    Hadoop Flags: [Reviewed]
    Status: Resolved (was: Patch Available)

    I just committed this. Thanks, Mahadev!
    Archvies sometimes create empty part files.
    -------------------------------------------

    Key: HADOOP-3560
    URL: https://issues.apache.org/jira/browse/HADOOP-3560
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/harchive
    Reporter: Mahadev konar
    Assignee: Mahadev konar
    Priority: Blocker
    Fix For: 0.18.0, 0.19.0

    Attachments: hadoop-3560_1.patch


    Archvies creates a bunch of empty part files sometimes which are not necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Jun 17, 2008 at 1:09 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605588#action_12605588 ]

    Hudson commented on HADOOP-3560:
    --------------------------------

    Integrated in Hadoop-trunk #521 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/521/])
    Archvies sometimes create empty part files.
    -------------------------------------------

    Key: HADOOP-3560
    URL: https://issues.apache.org/jira/browse/HADOOP-3560
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/harchive
    Reporter: Mahadev konar
    Assignee: Mahadev konar
    Priority: Blocker
    Fix For: 0.18.0, 0.19.0

    Attachments: hadoop-3560_1.patch


    Archvies creates a bunch of empty part files sometimes which are not necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJun 13, '08 at 8:22p
activeJun 17, '08 at 1:09p
posts8
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 8 posts

People

Translate

site design / logo © 2022 Grokbase