Grokbase › Groups › Hadoop › common-dev › January 2008
FAQ
hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
----------------------------------------------------------------------------------

Key: HADOOP-2582
URL: https://issues.apache.org/jira/browse/HADOOP-2582
Project: Hadoop
Issue Type: Bug
Components: dfs
Affects Versions: 0.15.2
Reporter: lohit vijayarenu


hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.

{noformat}
[lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
[lohit@ hadoop-trunk]$ ls -l nosuchfile
-rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
[lohit@ hadoop-trunk]$
{noformat}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • lohit vijayarenu (JIRA) at Jan 12, 2008 at 12:09 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2582:
    -------------------------------------

    Attachment: HADOOP_2582_1.patch

    Attached is a simple patch which checks for existence of source before initiating copy. Have updated TestDFSShell test case to check for this condition as well.
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Attachments: HADOOP_2582_1.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 12, 2008 at 12:26 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558172#action_12558172 ]

    Raghu Angadi commented on HADOOP-2582:
    --------------------------------------

    Seems like a bug in FileUtil.copy(), shouldn't it throw an expection or at least return false if source file does not exist?

    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Attachments: HADOOP_2582_1.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Jan 12, 2008 at 1:15 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2582:
    -------------------------------------

    Attachment: HADOOP_2582_2.patch

    Thanks Raghu, I have attached another patch which fixes FileUtil. Now we catch both -get and -put errors.
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 12, 2008 at 3:19 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558192#action_12558192 ]

    Raghu Angadi commented on HADOOP-2582:
    --------------------------------------

    +1. looks good.
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Jan 12, 2008 at 3:53 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2582:
    -------------------------------------

    Status: Patch Available (was: Open)

    thanks raghu. making it PA
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Jan 12, 2008 at 9:06 pm ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558294#action_12558294 ]

    Hadoop QA commented on HADOOP-2582:
    -----------------------------------

    +1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12373023/HADOOP_2582_2.patch
    against trunk revision r611385.

    @author +1. The patch does not contain any @author tags.

    javadoc +1. The javadoc tool did not generate any warning messages.

    javac +1. The applied patch does not generate any new compiler warnings.

    findbugs +1. The patch does not introduce any new Findbugs warnings.

    core tests +1. The patch passed core unit tests.

    contrib tests +1. The patch passed contrib unit tests.

    Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1560/testReport/
    Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1560/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1560/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1560/console

    This message is automatically generated.
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Mukund Madhugiri (JIRA) at Jan 14, 2008 at 6:27 pm ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558710#action_12558710 ]

    Mukund Madhugiri commented on HADOOP-2582:
    ------------------------------------------

    +1. The output looks good
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Jan 19, 2008 at 3:38 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Chris Douglas updated HADOOP-2582:
    ----------------------------------

    Resolution: Fixed
    Fix Version/s: 0.16.0
    Status: Resolved (was: Patch Available)
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Assignee: lohit vijayarenu
    Fix For: 0.16.0

    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Jan 19, 2008 at 3:38 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560652#action_12560652 ]

    Chris Douglas commented on HADOOP-2582:
    ---------------------------------------

    I just committed this. Thanks, Lohit!
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Fix For: 0.16.0

    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Jan 19, 2008 at 3:39 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Chris Douglas reassigned HADOOP-2582:
    -------------------------------------

    Assignee: lohit vijayarenu
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Assignee: lohit vijayarenu
    Fix For: 0.16.0

    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Jan 19, 2008 at 4:03 am ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560654#action_12560654 ]

    Hudson commented on HADOOP-2582:
    --------------------------------

    Integrated in Hadoop-Nightly #14 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Nightly/14/])
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Assignee: lohit vijayarenu
    Fix For: 0.16.0

    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Jan 19, 2008 at 1:56 pm ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560695#action_12560695 ]

    Hudson commented on HADOOP-2582:
    --------------------------------

    Integrated in Hadoop-Nightly #370 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/370/])
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Assignee: lohit vijayarenu
    Fix For: 0.16.0

    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Jan 19, 2008 at 5:04 pm ⇧
    [ https://issues.apache.org/jira/browse/HADOOP-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560712#action_12560712 ]

    Hudson commented on HADOOP-2582:
    --------------------------------

    Integrated in Hadoop-trunk #370 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/370/])
    hadoop dfs -copyToLocal creates zero byte files, when source file does not exists
    ----------------------------------------------------------------------------------

    Key: HADOOP-2582
    URL: https://issues.apache.org/jira/browse/HADOOP-2582
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.15.2
    Reporter: lohit vijayarenu
    Assignee: lohit vijayarenu
    Fix For: 0.16.0

    Attachments: HADOOP_2582_1.patch, HADOOP_2582_2.patch


    hadoop dfs -copyToLocal with an no existing source file creates a zero byte destination file. It should throw an error message indicating the source file does not exists.
    {noformat}
    [lohit@ hadoop-trunk]$ hadoop dfs -get nosuchfile nosuchfile
    [lohit@ hadoop-trunk]$ ls -l nosuchfile
    -rw-r--r-- 1 lohit users 0 Jan 11 21:58 nosuchfile
    [lohit@ hadoop-trunk]$
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJan 11, '08 at 10:03p
activeJan 19, '08 at 5:04p
posts14
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 14 posts

Content

People

Support

Translate

site design / logo © 2022 Grokbase