FAQ
[ https://issues.apache.org/jira/browse/HDFS-38?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karam Singh resolved HDFS-38.
-----------------------------

Resolution: Not A Problem
Release Note: Now I do not see this problem so marking this issue Resloved Not a problem
DFSClient getting stuck intermittently giving "DFSClient: Could not complete file filename retrying..." message
-----------------------------------------------------------------------------------------------------------------

Key: HDFS-38
URL: https://issues.apache.org/jira/browse/HDFS-38
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Karam Singh

While some streaming job with hadoop 0.18 and hadoop trunk, hadoop commands getting stuck intermittently and keeps on printing message "DFSClient: <filename>Could not complete file retrying..." in indefinite loop .
I have not faced this problem in hadoop 0.17,2.
On one occasion after copying to hdfs second command "hadoop fs - put file.txt input/in.txt" got stuck in hadoop 0.18 and hadoop trunk version
Following is the message -:
[
08/07/24 05:03:58 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying...
08/07/24 05:03:59 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying...
08/07/24 05:03:59 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying...
]
On second occasion command -: "hadoop jar hadoop-0.19.0-dev-examples.jar randomtextwriter rwout" got stuck with following -:
[
08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying...
08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying...
08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying...
08/07/24 08:39:07 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying...
]
This is intermittent and there is no specific pattern. I do not have namenode logs as I was hod for cluster allocation/deallocation with saving logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
categorieshadoop
postedFeb 9, '10 at 12:38p
activeFeb 9, '10 at 12:38p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Karam Singh (JIRA): 1 post

People

Translate

site design / logo © 2022 Grokbase