FAQ
In the ReduceTask.java having the below code

maxSize = (int)(conf.getInt("mapred.job.reduce.total.mem.bytes",
(int)Math.min(Runtime.getRuntime().maxMemory(),
Integer.MAX_VALUE))
* maxInMemCopyUse);

But in the patch
maxSize = (long)Math.min(
Runtime.getRuntime().maxMemory() * maxInMemCopyUse,
Integer.MAX_VALUE);

Whether cdh3u1 not holding this fix?
Kindly Advice.

Cheers!
Manoj.


On Mon, Dec 10, 2012 at 6:39 PM, Manoj Babu wrote:

at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1302)

Search Discussions

  • Manoj Babu at Dec 10, 2012 at 1:38 pm
    Please ignore the above comment.

    Cheers!
    Manoj.


    On Mon, Dec 10, 2012 at 6:59 PM, Manoj Babu wrote:

    In the ReduceTask.java having the below code

    maxSize = (int)(conf.getInt("mapred.job.reduce.total.mem.bytes",
    (int)Math.min(Runtime.getRuntime().maxMemory(),
    Integer.MAX_VALUE))
    * maxInMemCopyUse);

    But in the patch
    maxSize = (long)Math.min(
    Runtime.getRuntime().maxMemory() * maxInMemCopyUse,
    Integer.MAX_VALUE);

    Whether cdh3u1 not holding this fix?
    Kindly Advice.

    Cheers!
    Manoj.


    On Mon, Dec 10, 2012 at 6:39 PM, Manoj Babu wrote:

    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1302)

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedDec 10, '12 at 1:29p
activeDec 10, '12 at 1:38p
posts2
users1
websitecloudera.com
irc#hadoop

1 user in discussion

Manoj Babu: 2 posts

People

Translate

site design / logo © 2022 Grokbase