FAQ
distcp -delete option deletes all files from the destination directory
----------------------------------------------------------------------

Key: HADOOP-5227
URL: https://issues.apache.org/jira/browse/HADOOP-5227
Project: Hadoop Core
Issue Type: Bug
Components: tools/distcp
Reporter: Suhas Gogate


distcp -delete option deletes all the files from the destination even though they are present on the source.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Tsz Wo (Nicholas), SZE (JIRA) at Feb 12, 2009 at 12:08 am
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12672834#action_12672834 ]

    Tsz Wo (Nicholas), SZE commented on HADOOP-5227:
    ------------------------------------------------

    Currently, -delete does not work well with -update. If a file exist in both src and dst, -update tells distcp to skip such file but then -delete cannot see it (since it is skipped).
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate

    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Feb 12, 2009 at 1:36 am
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Tsz Wo (Nicholas), SZE updated HADOOP-5227:
    -------------------------------------------

    Attachment: 5227_20080211b.patch

    5227_20080211b.patch:
    - only skip file in the copy list but not the check list.
    - always check all files in the src (instead of skipping the remaining files once filelimit or sizelimit is exceeded).
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Attachments: 5227_20080211b.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Feb 12, 2009 at 10:23 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Tsz Wo (Nicholas), SZE updated HADOOP-5227:
    -------------------------------------------

    Assignee: Tsz Wo (Nicholas), SZE
    Status: Patch Available (was: Open)

    Tested locally, submitting...
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Assignee: Tsz Wo (Nicholas), SZE
    Attachments: 5227_20080211b.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Feb 14, 2009 at 1:53 am
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12673453#action_12673453 ]

    Hadoop QA commented on HADOOP-5227:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12400071/5227_20080211b.patch
    against trunk revision 744224.

    +1 @author. The patch does not contain any @author tags.

    +1 tests included. The patch appears to include 4 new or modified tests.

    +1 javadoc. The javadoc tool did not generate any warning messages.

    +1 javac. The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs. The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    +1 release audit. The applied patch does not increase the total number of release audit warnings.

    -1 core tests. The patch failed core unit tests.

    +1 contrib tests. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3849/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3849/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3849/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3849/console

    This message is automatically generated.
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Assignee: Tsz Wo (Nicholas), SZE
    Attachments: 5227_20080211b.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Feb 19, 2009 at 1:43 am
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Chris Douglas updated HADOOP-5227:
    ----------------------------------

    Hadoop Flags: [Reviewed]

    +1

    I'm not sure what semantics a user might expect when \-update and \-delete are combined, but this seems like the right fix to me.
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Assignee: Tsz Wo (Nicholas), SZE
    Attachments: 5227_20080211b.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Feb 19, 2009 at 1:45 am
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Chris Douglas updated HADOOP-5227:
    ----------------------------------

    Resolution: Fixed
    Fix Version/s: 0.21.0
    Status: Resolved (was: Patch Available)

    I committed this. Thanks, Nicholas
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Assignee: Tsz Wo (Nicholas), SZE
    Fix For: 0.21.0

    Attachments: 5227_20080211b.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Feb 23, 2009 at 3:19 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12675938#action_12675938 ]

    Hudson commented on HADOOP-5227:
    --------------------------------

    Integrated in Hadoop-trunk #763 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/763/])

    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Assignee: Tsz Wo (Nicholas), SZE
    Fix For: 0.21.0

    Attachments: 5227_20080211b.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Feb 23, 2009 at 9:52 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Tsz Wo (Nicholas), SZE updated HADOOP-5227:
    -------------------------------------------

    Attachment: 5227_20080211b_0.18+3939_20080829b_0.18+3873_20080811b_0.18.patch

    5227_20080211b_0.18+3939_20080829b_0.18+3873_20080811b_0.18.patch: patch for 0.18 (it won't be committed).
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Assignee: Tsz Wo (Nicholas), SZE
    Fix For: 0.21.0

    Attachments: 5227_20080211b.patch, 5227_20080211b_0.18+3939_20080829b_0.18+3873_20080811b_0.18.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Apr 3, 2009 at 10:32 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Tsz Wo (Nicholas), SZE reopened HADOOP-5227:
    --------------------------------------------


    Reopen this for committing the patch to 0.20.
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Assignee: Tsz Wo (Nicholas), SZE
    Fix For: 0.21.0

    Attachments: 5227_20080211b.patch, 5227_20080211b_0.18+3939_20080829b_0.18+3873_20080811b_0.18.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Apr 3, 2009 at 10:56 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Tsz Wo (Nicholas), SZE resolved HADOOP-5227.
    --------------------------------------------

    Resolution: Fixed
    Fix Version/s: 0.20.0

    I committed 5227_20080211b.patch to 0.20.
    distcp -delete option deletes all files from the destination directory
    ----------------------------------------------------------------------

    Key: HADOOP-5227
    URL: https://issues.apache.org/jira/browse/HADOOP-5227
    Project: Hadoop Core
    Issue Type: Bug
    Components: tools/distcp
    Reporter: Suhas Gogate
    Assignee: Tsz Wo (Nicholas), SZE
    Fix For: 0.20.0, 0.21.0

    Attachments: 5227_20080211b.patch, 5227_20080211b_0.18+3939_20080829b_0.18+3873_20080811b_0.18.patch


    distcp -delete option deletes all the files from the destination even though they are present on the source.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedFeb 11, '09 at 9:40p
activeApr 3, '09 at 10:56p
posts11
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Tsz Wo (Nicholas), SZE (JIRA): 11 posts

People

Translate

site design / logo © 2022 Grokbase