FAQ
Hi Joe,

A copy of each is typically included in the hadoop jars (core i
think). Try unzipping them and having a look.

Ta

Jamie

On 13 September 2010 15:51, Joe Ciaramitaro
wrote:
I'm running 2 VirtualBox instances of CentOS 5.5 to practice a migration from hadoop 0.18.3 to 0.20.2

Although the script I followed worked fine and I was able to migrate my filesystem to the new version, whenever I run anything on the virtual cluster, even a simple "hadoop dfs -ls", I get the following errors:

10/09/13 10:41:10 WARN conf.Configuration: hdfs-default.xml:a attempt to override final parameter: dfs.datanode.handler.count;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: hdfs-default.xml:a attempt to override final parameter: dfs.datanode.du.reserved;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: hdfs-default.xml:a attempt to override final parameter: dfs.name.dir;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: hdfs-default.xml:a attempt to override final parameter: dfs.permissions;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: hdfs-default.xml:a attempt to override final parameter: dfs.data.dir;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: hdfs-default.xml:a attempt to override final parameter: dfs.replication;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: hdfs-default.xml:a attempt to override final parameter: dfs.block.size;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: hdfs-default.xml:a attempt to override final parameter: dfs.namenode.handler.count;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.job.tracker;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.job.tracker.handler.count;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.local.dir;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.reduce.tasks;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.jobtracker.taskScheduler;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.reduce.parallel.copies;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.child.java.opts;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.reduce.tasks.speculative.execution;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: tasktracker.http.threads;  Ignoring.
10/09/13 10:41:10 WARN conf.Configuration: mapred-default.xml:a attempt to override final parameter: mapred.output.compression.type;  Ignoring.

I understand what the message is saying, but I cannot find hdfs-default.xml or mapred-default.xml anywhere on either machine.

[hadoop@localhost conf]$ locate mapred-default.xml
[hadoop@localhost conf]$ locate hdfs-default.xml

Please help.

-Joe

Search Discussions

Discussion Posts

Previous

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 2 of 3 | next ›
Discussion Overview
groupcommon-user @
categorieshadoop
postedSep 13, '10 at 2:51p
activeSep 13, '10 at 7:57p
posts3
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Joe Ciaramitaro: 2 posts Jamie Cockrill: 1 post

People

Translate

site design / logo © 2021 Grokbase