FAQ
excellent. I will keep the group posted as I progress.
On 11/7/07, Raghu Angadi wrote:

Not a complete list by far, but just a start :

For HDFS:

- Make sure you run Java 6 (jdk1.6).
- Set namenode handler count to 40 or more (dfs.namenode.handler.count,
and may be mapred.job.tracker.handler.count etc).

- more config guides are in the works :
https://issues.apache.org/jira/browse/HADOOP-1917

Raghu.

Derek Gottfrid wrote:
Are there configuration suggestions for 1k nodes ? I was seeing tons
of timeouts trying to run 1k nodes. Are there network settings that I
need to make? Out of the box stuff seemed to work up to a couple
hundred but I want to go bigger. Pointers/Suggestions?

derek


ps: i wrote up my ec2/hadoop at nytimes.com - check it out
http://open.blogs.nytimes.com/2007/11/01/self-service-prorated-super-computing-fun/

Search Discussions

Discussion Posts

Previous

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 3 of 5 | next ›
Discussion Overview
groupcommon-user @
categorieshadoop
postedNov 7, '07 at 4:03a
activeNov 7, '07 at 8:41p
posts5
users4
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase