FAQ
Hi

Some time ago I wrote java code for Hadoop 1.0.4 and MP1 - part of the code:

...

System.setProperty("HADOOP_USER_NAME", "hduser");

Configuration conf = new Configuration();

conf.set("fs.default.name", "hdfs://servername:54310");

conf.set("mapred.job.tracker", "servername:54311");

ToolRunner.run(conf, new ForestBuilder(clientID, minSplitNum), args);

...

and it works with hadoop 1.0.4 and MR1.

Now I have hadoop2 and MR2 (YARN)

And my old code does not work anymore. hdfs functions are accessible I can
upload files using my java code but jobs will be running in LocalJobRunner
mode.

Additionally I execute java code remotely.

As I understand I have to do something with a conf variable but I can't
find any good example how to use ToolRunner with a MP2.

Any advice? Best regards, Margus Roo


To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Search Discussions

  • Darren Lo at Feb 12, 2014 at 7:21 pm
    Moving to cdh-user (bcc scm-users)

    The following may be helpful:
    http://blog.cloudera.com/blog/2013/11/migrating-to-mapreduce-2-on-yarn-for-operators/
    http://blog.cloudera.com/blog/2013/11/migrating-to-mapreduce-2-on-yarn-for-users/

    I think any configuration with the name "mapred" is deprecated. The newer
    names use "mapreduce" in the configuration names. You may need to update to
    use the new configuration names.

    Thanks,
    Darren

    On Wed, Feb 12, 2014 at 11:14 AM, Margusja . wrote:

    Hi

    Some time ago I wrote java code for Hadoop 1.0.4 and MP1 - part of the
    code:

    ...

    System.setProperty("HADOOP_USER_NAME", "hduser");

    Configuration conf = new Configuration();

    conf.set("fs.default.name", "hdfs://servername:54310");

    conf.set("mapred.job.tracker", "servername:54311");

    ToolRunner.run(conf, new ForestBuilder(clientID, minSplitNum), args);

    ...

    and it works with hadoop 1.0.4 and MR1.

    Now I have hadoop2 and MR2 (YARN)

    And my old code does not work anymore. hdfs functions are accessible I can
    upload files using my java code but jobs will be running in LocalJobRunner
    mode.

    Additionally I execute java code remotely.

    As I understand I have to do something with a conf variable but I can't
    find any good example how to use ToolRunner with a MP2.

    Any advice? Best regards, Margus Roo


    To unsubscribe from this group and stop receiving emails from it, send an
    email to scm-users+unsubscribe@cloudera.org.


    --
    Thanks,
    Darren

    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedFeb 12, '14 at 7:14p
activeFeb 12, '14 at 7:21p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Darren Lo: 1 post Margusja .: 1 post

People

Translate

site design / logo © 2022 Grokbase