That shouldn't be a problem. The MapReduce config, as evidenced by the
alternatives configuration, takes precedence as it should. Since you have
that configured properly, I would focus on bc's recommendations. Run 'ls
-ld /etc/hadoop/conf' and see if it's linked to anything other than
/etc/alternatives/hadoop-conf. If so, you will need to correct that so that
/etc/hadoop/conf is a link to /etc/alternatives/hadoop-conf.

You can verify that mapred-site.xml is being deployed properly by looking
in /etc/hadoop/conf.cloudera.mapreduce1.

Thank you,

Brian Burton
Customer Operations Engineer, Cloudera

On Thu, Nov 29, 2012 at 3:38 PM, Benjamin Kim wrote:

Hi Brian,

I have the same box as both the hdfs and mapreduce gateway. Could this be
causing a conflict? It's also the hbase gateway.


On Thursday, November 29, 2012 12:22:26 PM UTC-8, bdb wrote:

Hi Benjamin,

I suspect you only added an HDFS Gateway role. You'll need to add one for
MapReduce. In fact, since MapReduce is a superset of HDFS configs, you
don't even need an HDFS Gateway role, just a MapReduce one.

You add it the same way you would for an HDFS Gateway role.


Brian Burton
Customer Operations Engineer, Cloudera

On Thu, Nov 29, 2012 at 3:10 PM, Benjamin Kim wrote:

Hi bc,

This is what I get.

hadoop-conf - status is auto.
link currently points to /etc/hadoop/conf.cloudera.**mapreduce1
/etc/hadoop/conf.empty - priority 10
/etc/hadoop/conf.cloudera.**hdfs1 - priority 90
/etc/hadoop/conf.cloudera.**mapreduce1 - priority 91
Current `best' version is /etc/hadoop/conf.cloudera.**mapreduce1.

It looks like Hive does not look in this directory. The mapped-site.xml
plus other config files are there.

How do I make Hive automatically look there? How do I find out where
Hive is looking?

On Thursday, November 29, 2012 11:51:38 AM UTC-8, bc Wong wrote:

Can you run `update-alternatives --display hadoop-conf' and tell me
what you see?


On Thu, Nov 29, 2012 at 11:34 AM, Benjamin Kim wrote:

I noticed that when I want to deploy configuration changes to a
Gateway box that the mapped-site.xml does not get pushed to
/etc/hadoop/conf/. Am I missing something or is this the way it should be?
I had to manually download it from Client Configuration URLs and save it
there. I noticed it when using Hive to run a query. It kept doing a local
mapreduce job. After copying it over, it now uses the cluster.


Search Discussions

Discussion Posts


Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 8 of 10 | next ›
Discussion Overview
groupscm-users @
postedNov 29, '12 at 7:34p
activeNov 30, '12 at 12:49a



site design / logo © 2022 Grokbase