FAQ
distcp skipping healthy files with "-i" option
-----------------------------------------------

Key: HADOOP-1507
URL: https://issues.apache.org/jira/browse/HADOOP-1507
Project: Hadoop
Issue Type: Bug
Components: util
Affects Versions: 0.12.3
Reporter: Koji Noguchi


Copied about million files. 8 files were corrupted. (checksum errors)

When I used distcp "-i", (skip read error files), it skipped about 300 files.

I need to check if it was really read errors or if distcp is skipping files more than necessary.



--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Owen O'Malley (JIRA) at Oct 24, 2007 at 6:23 pm
    [ https://issues.apache.org/jira/browse/HADOOP-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537376 ]

    Owen O'Malley commented on HADOOP-1507:
    ---------------------------------------

    Koji,
    Can I close this? Or are you still having problems with the Hadoop 0.15 version of distcp?
    distcp skipping healthy files with "-i" option
    -----------------------------------------------

    Key: HADOOP-1507
    URL: https://issues.apache.org/jira/browse/HADOOP-1507
    Project: Hadoop
    Issue Type: Bug
    Components: util
    Affects Versions: 0.12.3
    Reporter: Koji Noguchi

    Copied about million files. 8 files were corrupted. (checksum errors)
    When I used distcp "-i", (skip read error files), it skipped about 300 files.
    I need to check if it was really read errors or if distcp is skipping files more than necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Koji Noguchi (JIRA) at Oct 24, 2007 at 6:39 pm
    [ https://issues.apache.org/jira/browse/HADOOP-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Koji Noguchi resolved HADOOP-1507.
    ----------------------------------

    Resolution: Cannot Reproduce

    bq. Can I close this? Or are you still having problems with the Hadoop 0.15 version of distcp?

    Closing. I cannot reproduce it after the upgrades.

    distcp skipping healthy files with "-i" option
    -----------------------------------------------

    Key: HADOOP-1507
    URL: https://issues.apache.org/jira/browse/HADOOP-1507
    Project: Hadoop
    Issue Type: Bug
    Components: util
    Affects Versions: 0.12.3
    Reporter: Koji Noguchi

    Copied about million files. 8 files were corrupted. (checksum errors)
    When I used distcp "-i", (skip read error files), it skipped about 300 files.
    I need to check if it was really read errors or if distcp is skipping files more than necessary.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJun 19, '07 at 10:24p
activeOct 24, '07 at 6:39p
posts3
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Koji Noguchi (JIRA): 3 posts

People

Translate

site design / logo © 2022 Grokbase