FAQ

Cloudera Mapred-site.xml

Nicolas Maillard
Nov 21, 2012 at 3:12 pm
Hi everyone

I have installed a mapreduce service in cloudera manager however neither
hive nor hbase seem to be using it.
In th opensource distibution I had to add my direcotry containing amongst
others the mapred-site.xml for the system to work with the mapreduce
cluster.
Do I have to do the same with cloudera and If so where is the
mapred-site.xml located.
I can't find in /etc/hadoop/conf nor in /usr/lib/hadoop-0.20-mapreduce/conf
There is one in /etc/hadoop/conf.empty but it is empty.

Thnaks for your help

--
reply

Search Discussions

8 responses

  • Kevin O'dell at Nov 21, 2012 at 3:22 pm
    Nicolas,

    Make sure you have deployed your client configs. If you have the
    hbase-site should be in /etc/hbase/conf. You will want to set your Hadoop
    classpath to have the hbase-site on it. What is the particular problem you
    are running into?
    On Wed, Nov 21, 2012 at 10:05 AM, Nicolas Maillard wrote:

    Hi everyone

    I have installed a mapreduce service in cloudera manager however neither
    hive nor hbase seem to be using it.
    In th opensource distibution I had to add my direcotry containing amongst
    others the mapred-site.xml for the system to work with the mapreduce
    cluster.
    Do I have to do the same with cloudera and If so where is the
    mapred-site.xml located.
    I can't find in /etc/hadoop/conf nor in /usr/lib/hadoop-0.20-mapreduce/conf
    There is one in /etc/hadoop/conf.empty but it is empty.

    Thnaks for your help

    --




    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --
  • Nicolas Maillard at Nov 21, 2012 at 3:38 pm
    Hey Kevin

    I do have the hbase-site in /etc/hbase/conf although is is empty I had not
    looked at it yet.
    I was looking for mapred-site.xml for the mapreduce jobs.
    But Still wierd that hbase-site.xml would be empty, since the hbase seems
    to be doing fine and I have changed some values in the cloudera manager
    interface.

    How do I make sure my client configs have been deployed correctly. Cloudera
    manager seems to say all is good and I only have one machine in the cluster
    for now so I get the feeling they have been deployed correctly.
    On Wed, Nov 21, 2012 at 4:15 PM, Kevin O'dell wrote:

    Nicolas,

    Make sure you have deployed your client configs. If you have the
    hbase-site should be in /etc/hbase/conf. You will want to set your Hadoop
    classpath to have the hbase-site on it. What is the particular problem you
    are running into?

    On Wed, Nov 21, 2012 at 10:05 AM, Nicolas Maillard <
    nic...@...com> wrote:
    Hi everyone

    I have installed a mapreduce service in cloudera manager however neither
    hive nor hbase seem to be using it.
    In th opensource distibution I had to add my direcotry containing amongst
    others the mapred-site.xml for the system to work with the mapreduce
    cluster.
    Do I have to do the same with cloudera and If so where is the
    mapred-site.xml located.
    I can't find in /etc/hadoop/conf nor
    in /usr/lib/hadoop-0.20-mapreduce/conf
    There is one in /etc/hadoop/conf.empty but it is empty.

    Thnaks for your help

    --




    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --


    --
  • Kevin O'dell at Nov 21, 2012 at 3:39 pm
    Can you provide an ls /etc/hbase, it is actually in an alternatives folder
    that I don't have in front of me right this second.
    On Wed, Nov 21, 2012 at 10:38 AM, Nicolas Maillard wrote:

    Hey Kevin

    I do have the hbase-site in /etc/hbase/conf although is is empty I had not
    looked at it yet.
    I was looking for mapred-site.xml for the mapreduce jobs.
    But Still wierd that hbase-site.xml would be empty, since the hbase seems
    to be doing fine and I have changed some values in the cloudera manager
    interface.

    How do I make sure my client configs have been deployed correctly.
    Cloudera manager seems to say all is good and I only have one machine in
    the cluster for now so I get the feeling they have been deployed correctly.
    On Wed, Nov 21, 2012 at 4:15 PM, Kevin O'dell wrote:

    Nicolas,

    Make sure you have deployed your client configs. If you have the
    hbase-site should be in /etc/hbase/conf. You will want to set your Hadoop
    classpath to have the hbase-site on it. What is the particular problem you
    are running into?

    On Wed, Nov 21, 2012 at 10:05 AM, Nicolas Maillard <
    nic...@...com> wrote:
    Hi everyone

    I have installed a mapreduce service in cloudera manager however neither
    hive nor hbase seem to be using it.
    In th opensource distibution I had to add my direcotry containing
    amongst others the mapred-site.xml for the system to work with the
    mapreduce cluster.
    Do I have to do the same with cloudera and If so where is the
    mapred-site.xml located.
    I can't find in /etc/hadoop/conf nor
    in /usr/lib/hadoop-0.20-mapreduce/conf
    There is one in /etc/hadoop/conf.empty but it is empty.

    Thnaks for your help

    --




    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --


    --




    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --
  • Nicolas Maillard at Nov 21, 2012 at 3:52 pm
    hey kevin

    ll /etc/hbase/
    total 12
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 28 Nov 16 12:12 conf ->
    /etc/alternatives/hbase-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 conf.dist/

    For the alternatve:

    ll /etc/alternatives/hbase-conf/
    total 36
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ../
    -rw-r--r-- 1 root root 2335 Nov 2 02:02 hadoop-metrics.properties
    -rw-r--r-- 1 root root 4261 Nov 2 02:02 hbase-env.sh
    -rw-r--r-- 1 root root 2250 Nov 2 02:02 hbase-policy.xml
    -rw-r--r-- 1 root root 983 Nov 2 02:02 hbase-site.xml
    -rw-r--r-- 1 root root 2546 Nov 2 02:02 log4j.properties
    -rw-r--r-- 1 root root 10 Nov 2 02:02 regionservers

    for hadoop ll /etc/hadoop
    total 16
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 29 Nov 16 12:10 conf ->
    /etc/alternatives/hadoop-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 conf.cloudera.hdfs1/
    drwxr-xr-x 2 root hadoop 4096 Nov 16 12:11 conf.empty/


    On Wed, Nov 21, 2012 at 4:39 PM, Kevin O'dell wrote:

    Can you provide an ls /etc/hbase, it is actually in an alternatives folder
    that I don't have in front of me right this second.


    On Wed, Nov 21, 2012 at 10:38 AM, Nicolas Maillard <
    nic...@...com> wrote:
    Hey Kevin

    I do have the hbase-site in /etc/hbase/conf although is is empty I had
    not looked at it yet.
    I was looking for mapred-site.xml for the mapreduce jobs.
    But Still wierd that hbase-site.xml would be empty, since the hbase seems
    to be doing fine and I have changed some values in the cloudera manager
    interface.

    How do I make sure my client configs have been deployed correctly.
    Cloudera manager seems to say all is good and I only have one machine in
    the cluster for now so I get the feeling they have been deployed correctly.
    On Wed, Nov 21, 2012 at 4:15 PM, Kevin O'dell wrote:

    Nicolas,

    Make sure you have deployed your client configs. If you have the
    hbase-site should be in /etc/hbase/conf. You will want to set your Hadoop
    classpath to have the hbase-site on it. What is the particular problem you
    are running into?

    On Wed, Nov 21, 2012 at 10:05 AM, Nicolas Maillard <
    nic...@...com> wrote:
    Hi everyone

    I have installed a mapreduce service in cloudera manager however
    neither hive nor hbase seem to be using it.
    In th opensource distibution I had to add my direcotry containing
    amongst others the mapred-site.xml for the system to work with the
    mapreduce cluster.
    Do I have to do the same with cloudera and If so where is the
    mapred-site.xml located.
    I can't find in /etc/hadoop/conf nor
    in /usr/lib/hadoop-0.20-mapreduce/conf
    There is one in /etc/hadoop/conf.empty but it is empty.

    Thnaks for your help

    --




    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --


    --




    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --


    --
  • Nicolas Maillard at Nov 21, 2012 at 4:03 pm
    Sorry forgot the ll for the conf of hadoop: As you can see I can't find a
    mapred-sied.xml file here, I am wondering if this ha sompething to do with
    my hbase or hive being in local mode

    ll /etc/alternatives/hadoop-conf/
    total 24
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 ./
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ../
    -rw-r--r-- 1 root root 548 Nov 16 12:24 core-site.xml
    -rw-r--r-- 1 root root 2355 Nov 16 12:24 hadoop-env.sh
    -rw-r--r-- 1 root root 918 Nov 16 12:24 hdfs-site.xml
    -rw-r--r-- 1 root root 314 Nov 16 12:24 log4j.properties
    -rw-r--r-- 1 root root 0 Nov 21 13:50 taskcontroller.cfg
    On Wed, Nov 21, 2012 at 4:46 PM, Nicolas Maillard wrote:

    hey kevin

    ll /etc/hbase/
    total 12
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 28 Nov 16 12:12 conf ->
    /etc/alternatives/hbase-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 conf.dist/

    For the alternatve:

    ll /etc/alternatives/hbase-conf/
    total 36
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ../
    -rw-r--r-- 1 root root 2335 Nov 2 02:02 hadoop-metrics.properties
    -rw-r--r-- 1 root root 4261 Nov 2 02:02 hbase-env.sh
    -rw-r--r-- 1 root root 2250 Nov 2 02:02 hbase-policy.xml
    -rw-r--r-- 1 root root 983 Nov 2 02:02 hbase-site.xml
    -rw-r--r-- 1 root root 2546 Nov 2 02:02 log4j.properties
    -rw-r--r-- 1 root root 10 Nov 2 02:02 regionservers

    for hadoop ll /etc/hadoop
    total 16
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 29 Nov 16 12:10 conf ->
    /etc/alternatives/hadoop-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 conf.cloudera.hdfs1/
    drwxr-xr-x 2 root hadoop 4096 Nov 16 12:11 conf.empty/


    On Wed, Nov 21, 2012 at 4:39 PM, Kevin O'dell wrote:

    Can you provide an ls /etc/hbase, it is actually in an alternatives
    folder that I don't have in front of me right this second.


    On Wed, Nov 21, 2012 at 10:38 AM, Nicolas Maillard <
    nic...@...com> wrote:
    Hey Kevin

    I do have the hbase-site in /etc/hbase/conf although is is empty I had
    not looked at it yet.
    I was looking for mapred-site.xml for the mapreduce jobs.
    But Still wierd that hbase-site.xml would be empty, since the hbase
    seems to be doing fine and I have changed some values in the cloudera
    manager interface.

    How do I make sure my client configs have been deployed correctly.
    Cloudera manager seems to say all is good and I only have one machine in
    the cluster for now so I get the feeling they have been deployed correctly.
    On Wed, Nov 21, 2012 at 4:15 PM, Kevin O'dell wrote:

    Nicolas,

    Make sure you have deployed your client configs. If you have the
    hbase-site should be in /etc/hbase/conf. You will want to set your Hadoop
    classpath to have the hbase-site on it. What is the particular problem you
    are running into?

    On Wed, Nov 21, 2012 at 10:05 AM, Nicolas Maillard <
    nic...@...com> wrote:
    Hi everyone

    I have installed a mapreduce service in cloudera manager however
    neither hive nor hbase seem to be using it.
    In th opensource distibution I had to add my direcotry containing
    amongst others the mapred-site.xml for the system to work with the
    mapreduce cluster.
    Do I have to do the same with cloudera and If so where is the
    mapred-site.xml located.
    I can't find in /etc/hadoop/conf nor
    in /usr/lib/hadoop-0.20-mapreduce/conf
    There is one in /etc/hadoop/conf.empty but it is empty.

    Thnaks for your help

    --




    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --


    --




    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --


    --
  • Mg at Nov 21, 2012 at 4:19 pm
    Hi,

    with service MapReduce V1 installed and the client configurations
    deployed correctly, there should be a directory named

    /etc/hadoop/conf.cloudera.mapreduce1

    which should contain the mapred-site.xml. The dir is linked to
    /etc/hadoop/conf via /etc/alternatives/hadoop-conf.

    You may check with sudo update-alternatives --display hadoop-conf

    This should list at least conf.cloudera.hdfs1 and
    conf.cloudera.mapreduce1 (possibly also conf.cloudera.empty)

    Cheers,
    Martin

    Am 21.11.2012 17:03, schrieb Nicolas Maillard:
    Sorry forgot the ll for the conf of hadoop: As you can see I can't find
    a mapred-sied.xml file here, I am wondering if this ha sompething to do
    with my hbase or hive being in local mode

    ll /etc/alternatives/hadoop-conf/
    total 24
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 ./
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ../
    -rw-r--r-- 1 root root 548 Nov 16 12:24 core-site.xml
    -rw-r--r-- 1 root root 2355 Nov 16 12:24 hadoop-env.sh
    -rw-r--r-- 1 root root 918 Nov 16 12:24 hdfs-site.xml
    -rw-r--r-- 1 root root 314 Nov 16 12:24 log4j.properties
    -rw-r--r-- 1 root root 0 Nov 21 13:50 taskcontroller.cfg

    On Wed, Nov 21, 2012 at 4:46 PM, Nicolas Maillard
    wrote:

    hey kevin

    ll /etc/hbase/
    total 12
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 28 Nov 16 12:12 conf ->
    /etc/alternatives/hbase-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 conf.dist/

    For the alternatve:

    ll /etc/alternatives/hbase-conf/
    total 36
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ../
    -rw-r--r-- 1 root root 2335 Nov 2 02:02 hadoop-metrics.properties
    -rw-r--r-- 1 root root 4261 Nov 2 02:02 hbase-env.sh
    -rw-r--r-- 1 root root 2250 Nov 2 02:02 hbase-policy.xml
    -rw-r--r-- 1 root root 983 Nov 2 02:02 hbase-site.xml
    -rw-r--r-- 1 root root 2546 Nov 2 02:02 log4j.properties
    -rw-r--r-- 1 root root 10 Nov 2 02:02 regionservers

    for hadoop ll /etc/hadoop
    total 16
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 29 Nov 16 12:10 conf ->
    /etc/alternatives/hadoop-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 conf.cloudera.hdfs1/
    drwxr-xr-x 2 root hadoop 4096 Nov 16 12:11 conf.empty/



    On Wed, Nov 21, 2012 at 4:39 PM, Kevin O'dell
    wrote:

    Can you provide an ls /etc/hbase, it is actually in an
    alternatives folder that I don't have in front of me right this
    second.


    On Wed, Nov 21, 2012 at 10:38 AM, Nicolas Maillard
    wrote:

    Hey Kevin

    I do have the hbase-site in /etc/hbase/conf although is is
    empty I had not looked at it yet.
    I was looking for mapred-site.xml for the mapreduce jobs.
    But Still wierd that hbase-site.xml would be empty, since
    the hbase seems to be doing fine and I have changed some
    values in the cloudera manager interface.

    How do I make sure my client configs have been deployed
    correctly. Cloudera manager seems to say all is good and I
    only have one machine in the cluster for now so I get the
    feeling they have been deployed correctly.

    On Wed, Nov 21, 2012 at 4:15 PM, Kevin O'dell
    wrote:

    Nicolas,

    Make sure you have deployed your client configs. If
    you have the hbase-site should be in /etc/hbase/conf.
    You will want to set your Hadoop classpath to have the
    hbase-site on it. What is the particular problem you
    are running into?

    On Wed, Nov 21, 2012 at 10:05 AM, Nicolas Maillard
    wrote:

    Hi everyone

    I have installed a mapreduce service in cloudera
    manager however neither hive nor hbase seem to be
    using it.
    In th opensource distibution I had to add my
    direcotry containing amongst others the
    mapred-site.xml for the system to work with the
    mapreduce cluster.
    Do I have to do the same with cloudera and If so
    where is the mapred-site.xml located.
    I can't find in /etc/hadoop/conf nor
    in /usr/lib/hadoop-0.20-mapreduce/conf
    There is one in /etc/hadoop/conf.empty but it is empty.

    Thnaks for your help

    --







    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --





    --







    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --






    --

    --
  • Nicolas Maillard at Nov 21, 2012 at 4:43 pm
    hi

    Ok that seems to be it i don't have /etc/hadoop/conf.cloudera.mapreduce1
    I have /etc/hadoop/conf.cloudera.hdfs1
    and /etc/alternatives/hadoop-conf

    On Wed, Nov 21, 2012 at 5:14 PM, mg wrote:

    Hi,

    with service MapReduce V1 installed and the client configurations
    deployed correctly, there should be a directory named

    /etc/hadoop/conf.cloudera.mapreduce1

    which should contain the mapred-site.xml. The dir is linked to
    /etc/hadoop/conf via /etc/alternatives/hadoop-conf.

    You may check with sudo update-alternatives --display hadoop-conf

    This should list at least conf.cloudera.hdfs1 and
    conf.cloudera.mapreduce1 (possibly also conf.cloudera.empty)

    Cheers,
    Martin

    Am 21.11.2012 17:03, schrieb Nicolas Maillard:
    Sorry forgot the ll for the conf of hadoop: As you can see I can't find
    a mapred-sied.xml file here, I am wondering if this ha sompething to do
    with my hbase or hive being in local mode

    ll /etc/alternatives/hadoop-conf/
    total 24
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 ./
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ../
    -rw-r--r-- 1 root root 548 Nov 16 12:24 core-site.xml
    -rw-r--r-- 1 root root 2355 Nov 16 12:24 hadoop-env.sh
    -rw-r--r-- 1 root root 918 Nov 16 12:24 hdfs-site.xml
    -rw-r--r-- 1 root root 314 Nov 16 12:24 log4j.properties
    -rw-r--r-- 1 root root 0 Nov 21 13:50 taskcontroller.cfg

    On Wed, Nov 21, 2012 at 4:46 PM, Nicolas Maillard
    <nic...@...com
    wrote:

    hey kevin

    ll /etc/hbase/
    total 12
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 28 Nov 16 12:12 conf ->
    /etc/alternatives/hbase-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 conf.dist/

    For the alternatve:

    ll /etc/alternatives/hbase-conf/
    total 36
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ../
    -rw-r--r-- 1 root root 2335 Nov 2 02:02 hadoop-metrics.properties
    -rw-r--r-- 1 root root 4261 Nov 2 02:02 hbase-env.sh
    -rw-r--r-- 1 root root 2250 Nov 2 02:02 hbase-policy.xml
    -rw-r--r-- 1 root root 983 Nov 2 02:02 hbase-site.xml
    -rw-r--r-- 1 root root 2546 Nov 2 02:02 log4j.properties
    -rw-r--r-- 1 root root 10 Nov 2 02:02 regionservers

    for hadoop ll /etc/hadoop
    total 16
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 29 Nov 16 12:10 conf ->
    /etc/alternatives/hadoop-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 conf.cloudera.hdfs1/
    drwxr-xr-x 2 root hadoop 4096 Nov 16 12:11 conf.empty/



    On Wed, Nov 21, 2012 at 4:39 PM, Kevin O'dell
    wrote:

    Can you provide an ls /etc/hbase, it is actually in an
    alternatives folder that I don't have in front of me right this
    second.


    On Wed, Nov 21, 2012 at 10:38 AM, Nicolas Maillard
    <nic...@...com
    wrote:

    Hey Kevin

    I do have the hbase-site in /etc/hbase/conf although is is
    empty I had not looked at it yet.
    I was looking for mapred-site.xml for the mapreduce jobs.
    But Still wierd that hbase-site.xml would be empty, since
    the hbase seems to be doing fine and I have changed some
    values in the cloudera manager interface.

    How do I make sure my client configs have been deployed
    correctly. Cloudera manager seems to say all is good and I
    only have one machine in the cluster for now so I get the
    feeling they have been deployed correctly.

    On Wed, Nov 21, 2012 at 4:15 PM, Kevin O'dell
    wrote:

    Nicolas,

    Make sure you have deployed your client configs. If
    you have the hbase-site should be in /etc/hbase/conf.
    You will want to set your Hadoop classpath to have the
    hbase-site on it. What is the particular problem you
    are running into?

    On Wed, Nov 21, 2012 at 10:05 AM, Nicolas Maillard
    <nic...@...com
    wrote:

    Hi everyone

    I have installed a mapreduce service in cloudera
    manager however neither hive nor hbase seem to be
    using it.
    In th opensource distibution I had to add my
    direcotry containing amongst others the
    mapred-site.xml for the system to work with the
    mapreduce cluster.
    Do I have to do the same with cloudera and If so
    where is the mapred-site.xml located.
    I can't find in /etc/hadoop/conf nor
    in /usr/lib/hadoop-0.20-mapreduce/conf
    There is one in /etc/hadoop/conf.empty but it is empty.
    Thnaks for your help

    --







    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --





    --







    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --






    --

    --


    --
  • Nicolas Maillard at Nov 21, 2012 at 4:52 pm
    Hi

    Sent by error
    So I have all the listed directories aside from
    the /etc/hadoop/conf.cloudera.mapreduce1
    I have stopped, deleted and re added the service.
    Cloudera says all is good.
    I can run hadopp jar examples..
    But this directory is still missing.

    What can I do to get it there, install manually?

    On Wed, Nov 21, 2012 at 5:42 PM, Nicolas Maillard wrote:

    hi

    Ok that seems to be it i don't have /etc/hadoop/conf.cloudera.mapreduce1
    I have /etc/hadoop/conf.cloudera.hdfs1
    and /etc/alternatives/hadoop-conf

    On Wed, Nov 21, 2012 at 5:14 PM, mg wrote:

    Hi,

    with service MapReduce V1 installed and the client configurations
    deployed correctly, there should be a directory named

    /etc/hadoop/conf.cloudera.mapreduce1

    which should contain the mapred-site.xml. The dir is linked to
    /etc/hadoop/conf via /etc/alternatives/hadoop-conf.

    You may check with sudo update-alternatives --display hadoop-conf

    This should list at least conf.cloudera.hdfs1 and
    conf.cloudera.mapreduce1 (possibly also conf.cloudera.empty)

    Cheers,
    Martin

    Am 21.11.2012 17:03, schrieb Nicolas Maillard:
    Sorry forgot the ll for the conf of hadoop: As you can see I can't find
    a mapred-sied.xml file here, I am wondering if this ha sompething to do
    with my hbase or hive being in local mode

    ll /etc/alternatives/hadoop-conf/
    total 24
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 ./
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ../
    -rw-r--r-- 1 root root 548 Nov 16 12:24 core-site.xml
    -rw-r--r-- 1 root root 2355 Nov 16 12:24 hadoop-env.sh
    -rw-r--r-- 1 root root 918 Nov 16 12:24 hdfs-site.xml
    -rw-r--r-- 1 root root 314 Nov 16 12:24 log4j.properties
    -rw-r--r-- 1 root root 0 Nov 21 13:50 taskcontroller.cfg

    On Wed, Nov 21, 2012 at 4:46 PM, Nicolas Maillard
    <nic...@...com
    wrote:

    hey kevin

    ll /etc/hbase/
    total 12
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 28 Nov 16 12:12 conf ->
    /etc/alternatives/hbase-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 conf.dist/

    For the alternatve:

    ll /etc/alternatives/hbase-conf/
    total 36
    drwxr-xr-x 2 root root 4096 Nov 16 12:12 ./
    drwxr-xr-x 3 root root 4096 Nov 16 12:12 ../
    -rw-r--r-- 1 root root 2335 Nov 2 02:02 hadoop-metrics.properties
    -rw-r--r-- 1 root root 4261 Nov 2 02:02 hbase-env.sh
    -rw-r--r-- 1 root root 2250 Nov 2 02:02 hbase-policy.xml
    -rw-r--r-- 1 root root 983 Nov 2 02:02 hbase-site.xml
    -rw-r--r-- 1 root root 2546 Nov 2 02:02 log4j.properties
    -rw-r--r-- 1 root root 10 Nov 2 02:02 regionservers

    for hadoop ll /etc/hadoop
    total 16
    drwxr-xr-x 4 root hadoop 4096 Nov 16 12:24 ./
    drwxr-xr-x 125 root root 4096 Nov 21 12:30 ../
    lrwxrwxrwx 1 root root 29 Nov 16 12:10 conf ->
    /etc/alternatives/hadoop-conf/
    drwxr-xr-x 2 root root 4096 Nov 16 12:43 conf.cloudera.hdfs1/
    drwxr-xr-x 2 root hadoop 4096 Nov 16 12:11 conf.empty/



    On Wed, Nov 21, 2012 at 4:39 PM, Kevin O'dell
    wrote:

    Can you provide an ls /etc/hbase, it is actually in an
    alternatives folder that I don't have in front of me right this
    second.


    On Wed, Nov 21, 2012 at 10:38 AM, Nicolas Maillard
    <nic...@...com
    wrote:

    Hey Kevin

    I do have the hbase-site in /etc/hbase/conf although is is
    empty I had not looked at it yet.
    I was looking for mapred-site.xml for the mapreduce jobs.
    But Still wierd that hbase-site.xml would be empty, since
    the hbase seems to be doing fine and I have changed some
    values in the cloudera manager interface.

    How do I make sure my client configs have been deployed
    correctly. Cloudera manager seems to say all is good and I
    only have one machine in the cluster for now so I get the
    feeling they have been deployed correctly.

    On Wed, Nov 21, 2012 at 4:15 PM, Kevin O'dell
    <kev...@...com > >>
    wrote:

    Nicolas,

    Make sure you have deployed your client configs. If
    you have the hbase-site should be in /etc/hbase/conf.
    You will want to set your Hadoop classpath to have the
    hbase-site on it. What is the particular problem you
    are running into?

    On Wed, Nov 21, 2012 at 10:05 AM, Nicolas Maillard
    <nic...@...com
    wrote:

    Hi everyone

    I have installed a mapreduce service in cloudera
    manager however neither hive nor hbase seem to be
    using it.
    In th opensource distibution I had to add my
    direcotry containing amongst others the
    mapred-site.xml for the system to work with the
    mapreduce cluster.
    Do I have to do the same with cloudera and If so
    where is the mapred-site.xml located.
    I can't find in /etc/hadoop/conf nor
    in /usr/lib/hadoop-0.20-mapreduce/conf
    There is one in /etc/hadoop/conf.empty but it is empty.
    Thnaks for your help

    --







    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --





    --







    --
    Kevin O'Dell
    Customer Operations Engineer, Cloudera

    --






    --

    --


    --

Related Discussions

Discussion Navigation
viewthread | post