FAQ
I have fresh install of CM4. I installed and tried to run the "Job
Designer" samples. The streaming_wordcount sample is failing with the
exception below.

java.lang.RuntimeException: java.lang.RuntimeException:
java.lang.ClassNotFoundException: Class
org.apache.hadoop.streaming.PipeMapRunner not found at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1603) at
org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:1010) at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:389) at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:327) at
org.apache.hadoop.mapred.Child$4.run(Child.java:268) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:396) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.mapred.Child.main(Child.java:262) Caused by:
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class
org.apache.hadoop.streaming.PipeMapRunner not found at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1571) at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1595)

I see jar files such as /usr/lib/hadoop-mapreduce/hadoop-streaming.jar that
look promising. That file is world readable and I've verified that is
contains PipeMapRunner. Do I need to specify the path somewhere? Why don't
the samples work out of the box?

Search Discussions

  • Romain Rigaux at Oct 15, 2012 at 4:53 pm
    The Oozie ShareLib needs to be installed (Hue is reusing Oozie under the
    cover). See #2 of
    https://ccp.cloudera.com/display/CDH4DOC/Hue+Installation#HueInstallation-JobDesignerandOozieApplicationConfiguration

    Then there is a current bug with potential workarounds:
    https://issues.cloudera.org/browse/HUE-877?focusedCommentId=14978&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14978

    Romain



    On Sat, Oct 13, 2012 at 11:45 PM, wrote:

    I have fresh install of CM4. I installed and tried to run the "Job
    Designer" samples. The streaming_wordcount sample is failing with the
    exception below.

    java.lang.RuntimeException: java.lang.RuntimeException:
    java.lang.ClassNotFoundException: Class
    org.apache.hadoop.streaming.PipeMapRunner not found at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1603) at
    org.apache.hadoop.mapred.JobConf.getMapRunnerClass(JobConf.java:1010) at
    org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:389) at
    org.apache.hadoop.mapred.MapTask.run(MapTask.java:327) at
    org.apache.hadoop.mapred.Child$4.run(Child.java:268) at
    java.security.AccessController.doPrivileged(Native Method) at
    javax.security.auth.Subject.doAs(Subject.java:396) at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
    at org.apache.hadoop.mapred.Child.main(Child.java:262) Caused by:
    java.lang.RuntimeException: java.lang.ClassNotFoundException: Class
    org.apache.hadoop.streaming.PipeMapRunner not found at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1571) at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1595)

    I see jar files such as /usr/lib/hadoop-mapreduce/hadoop-streaming.jar
    that look promising. That file is world readable and I've verified that is
    contains PipeMapRunner. Do I need to specify the path somewhere? Why don't
    the samples work out of the box?

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphue-user @
categorieshadoop
postedOct 14, '12 at 6:52a
activeOct 15, '12 at 4:53p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Schickb: 1 post Romain Rigaux: 1 post

People

Translate

site design / logo © 2022 Grokbase