FAQ
If I add "-inputformat", "org.apache.hadoop.mapred.lib.NLineInputFormat",
as one of the job config option in
org.apache.hadoop.streaming.TestMultipleCachefiles
the test case fails saying that it can not find the cached files (Few
relevant lines of the
info messages are pasted in the following). This test case
works fine with TextInputFormat. I wonder what goes wrong if I instead use
the NLineInputFormat?

2008-09-14 06:14:49,179 INFO mapred.TaskTracker
(TaskTracker.java:tryToGetOutputSize(1323)) -
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200809140613_0001/attempt_200809140613_0001_m_000000_0/output/file.out
in any of the configured local directories
2008-09-14 06:14:49,182 INFO mapred.TaskTracker
(TaskTracker.java:tryToGetOutputSize(1323)) -
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200809140613_0001/attempt_200809140613_0001_r_000000_0/output/file.out
in any of the configured local directories
2008-09-14 06:14:49,185 INFO mapred.TaskInProgress
(TaskInProgress.java:updateStatus(392)) - Error from
attempt_200809140613_0001_m_000000_0: java.lang.RuntimeException:
PipeMapRed.waitOutputThreads(): subprocess failed with code 123
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:295)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:519)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:136)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:56)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:254)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2217)



Abdul Qadeer

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedSep 14, '08 at 1:37p
activeSep 14, '08 at 1:37p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Abdul Qadeer: 1 post

People

Translate

site design / logo © 2022 Grokbase