[MapReduce-user] OOM: I can't set -Xmx!

-----Original Message-----
From: Fuad Efendi
Sent: January-10-10 12:31 AM
To: mapreduce-user@hadoop.apache.org
Subject: OOM: I can't set -Xmx!


After deep investigation of specific OOMs, it seems I can't set -
Xmx1024m
for MapRed tasks; memory analysis (for Mappers & Reducers) always shows
magic
-Xmx (maximal heap size) is 536870912 bytes

At the same time, for TaskTracker it shows
-Xmx (maximal heap size) is 1048576000 bytes


Strange! Hadoop 0.19.2, with hadoop-site.xml properly replicated in
cluster...
<property>
<name>mapred.child.java.opts</name>
<value>-server -Xms1g -Xmx1g</value>


Has anyone had anything like that? I can't set -Xmx!

-Fuad
http://www.tokenizer.ca

On Sat, Jan 9, 2010 at 9:31 PM, Fuad Efendi wrote:


After deep investigation of specific OOMs, it seems I can't set -Xmx1024m
for MapRed tasks; memory analysis (for Mappers & Reducers) always shows
magic
-Xmx (maximal heap size) is 536870912 bytes

At the same time, for TaskTracker it shows
-Xmx (maximal heap size) is 1048576000 bytes


Strange! Hadoop 0.19.2, with hadoop-site.xml properly replicated in
cluster...
<property>
<name>mapred.child.java.opts</name>
<value>-server -Xms1g -Xmx1g</value>


Has anyone had anything like that? I can't set -Xmx!

-Fuad
http://www.tokenizer.ca