Grokbase › Groups › Hadoop › scm-users › April 2013
FAQ
I am getting the following error in Jobtracker logs when i am running the
streaming job on the cluster configured with Cloudera Manager.


2013-04-04 01:15:48,847 INFO org.apache.hadoop.mapred.TaskInProgress: Error
from attempt_201304031813_0010_m_000000_0: java.lang.RuntimeException:
PipeMapRed.waitOutputThreads(): subprocess failed with code 1
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:572)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:136)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:418)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)

2013-04-04 01:15:49,150 INFO org.apache.hadoop.mapred.TaskInProgress: Error
from attempt_201304031813_0010_m_000001_0: java.lang.RuntimeException:
PipeMapRed.waitOutputThreads(): subprocess failed with code 1
at
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362)
at
org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:572)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:136)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:418)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)

Can anyone suggest how to come out of this error.

Search Discussions

  • Srikanth ayalasomayajulu at Apr 8, 2013 at 2:12 am ⇧
    Can any one suggest why am i getting this error. please

    On Wednesday, April 3, 2013 5:32:33 PM UTC+8, srikanth ayalasomayajulu
    wrote:

    I am getting the following error in Jobtracker logs when i am running the
    streaming job on the cluster configured with Cloudera Manager.


    2013-04-04 01:15:48,847 INFO org.apache.hadoop.mapred.TaskInProgress:
    Error from attempt_201304031813_0010_m_000000_0:
    java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess
    failed with code 1
    at
    org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362)
    at
    org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:572)
    at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:136)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:418)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)

    2013-04-04 01:15:49,150 INFO org.apache.hadoop.mapred.TaskInProgress:
    Error from attempt_201304031813_0010_m_000001_0:
    java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess
    failed with code 1
    at
    org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362)
    at
    org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:572)
    at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:136)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:418)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)

    Can anyone suggest how to come out of this error.
  • Harsh J at Apr 8, 2013 at 2:19 am ⇧
    Hi Srikanth,

    That error isn't a normal occurrence so a solution can't be directly
    given. In most cases, its the executable behaving bad in some way
    thats not working well with the streaming framework, and you should
    retry looking at your script and at your full task logs under the
    JobTracker UI to find out what exactly is going wrong during
    execution.

    On Mon, Apr 8, 2013 at 7:42 AM, srikanth ayalasomayajulu
    wrote:
    Can any one suggest why am i getting this error. please


    On Wednesday, April 3, 2013 5:32:33 PM UTC+8, srikanth ayalasomayajulu
    wrote:

    I am getting the following error in Jobtracker logs when i am running the
    streaming job on the cluster configured with Cloudera Manager.


    2013-04-04 01:15:48,847 INFO org.apache.hadoop.mapred.TaskInProgress:
    Error from attempt_201304031813_0010_m_000000_0: java.lang.RuntimeException:
    PipeMapRed.waitOutputThreads(): subprocess failed with code 1
    at
    org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362)
    at
    org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:572)
    at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:136)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:418)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)

    2013-04-04 01:15:49,150 INFO org.apache.hadoop.mapred.TaskInProgress:
    Error from attempt_201304031813_0010_m_000001_0: java.lang.RuntimeException:
    PipeMapRed.waitOutputThreads(): subprocess failed with code 1
    at
    org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362)
    at
    org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:572)
    at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:136)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:418)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)

    Can anyone suggest how to come out of this error.


    --
    Harsh J

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedApr 3, '13 at 9:32a
activeApr 8, '13 at 2:19a
posts3
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Srikanth ayalasomayajulu: 2 posts Harsh J: 1 post

Content

People

Support

Translate

site design / logo © 2022 Grokbase