FAQ
HI

I have my CDH3u4 cluster setup by CLoudera Manager.
I want to set Hadoop Classpath in order to read some Mesos classes. How can
I set it from CM. I tried to edit *hadoop-env.sh* in
*$HADOOP_HOME/conf*directly and added the following line:

export
HADOOP_CLASSPATH=/usr/lib/hadoop-0.20/build/contrib/mesos/classes/:$HADOOP_CLASSPATH

But getting the following JobTracker error in CM while restarting the
cluster:

java.lang.ClassNotFoundException: org.apache.hadoop.mapred.MesosScheduler

I also tried editing the hadoop-env.sh file by changing the line to:

export HADOOP_CLASSPATH=/usr/lib/hadoop-0.20/build/contrib/mesos/classes/:/usr/lib/hadoop-0.20/lib/mesos-0.9.0.jar:$HADOOP_CLASSPATH

And again same error. I have added the necessary MesosScheduler
properties in mapred-site.xml from CM and that seems to reflect fine.
Here the properties:

<property>
<name>mapred.jobtracker.taskScheduler</name>
<value>org.apache.hadoop.mapred.MesosScheduler</value>
</property>
<property>
<name>mapred.mesos.master</name>
<value>localhost.localdomain:5050</value>
</property>

Can some one tell me that how can I set HADOOP CLASSPATH from CM? Why
my JobTracker is not getting the CLASSPATH when it is set directly in
hadoop-env.sh?

Thanks,
Gaurav Dasgupta

Search Discussions

  • Philip Zeyliger at Sep 20, 2012 at 6:11 pm
    Hi Gaurav,

    You might be able to modify the following setting in CM "mapreduce service
    environment safety valve". Be aware that you're the first person I've
    heard of using Mesos with a CM cluster; let us know how it goes!

    -- Philip

    [image: Inline image 1]

    On Wed, Sep 19, 2012 at 9:01 PM, Gaurav Dasgupta wrote:

    HI

    I have my CDH3u4 cluster setup by CLoudera Manager.
    I want to set Hadoop Classpath in order to read some Mesos classes. How
    can I set it from CM. I tried to edit *hadoop-env.sh* in *
    $HADOOP_HOME/conf* directly and added the following line:

    export
    HADOOP_CLASSPATH=/usr/lib/hadoop-0.20/build/contrib/mesos/classes/:$HADOOP_CLASSPATH

    But getting the following JobTracker error in CM while restarting the
    cluster:

    java.lang.ClassNotFoundException: org.apache.hadoop.mapred.MesosScheduler


    I also tried editing the hadoop-env.sh file by changing the line to:

    export HADOOP_CLASSPATH=/usr/lib/hadoop-0.20/build/contrib/mesos/classes/:/usr/lib/hadoop-0.20/lib/mesos-0.9.0.jar:$HADOOP_CLASSPATH


    And again same error. I have added the necessary MesosScheduler properties in mapred-site.xml from CM and that seems to reflect fine. Here the properties:

    <property>
    <name>mapred.jobtracker.taskScheduler</name>
    <value>org.apache.hadoop.mapred.MesosScheduler</value>
    </property>
    <property>
    <name>mapred.mesos.master</name>


    <value>localhost.localdomain:5050</value>
    </property>

    Can some one tell me that how can I set HADOOP CLASSPATH from CM? Why my JobTracker is not getting the CLASSPATH when it is set directly in hadoop-env.sh?


    Thanks,
    Gaurav Dasgupta

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedSep 20, '12 at 4:01a
activeSep 20, '12 at 6:11p
posts2
users2
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2023 Grokbase