Grokbase Groups Pig user May 2008
FAQ
I think you need to increase the amount of memory you give to java.

It looks like it is currently set to 256M. I upped mine to 2G. Of
course it depends on how much ram you have available.

mapred.child.java.opts is the parameter
mine is currently set to 2048M in my hadoop-site.xml file.

For performance reasons, I upped the io.sort.mb parameter. However,
if this is too close to 50% of the total memory, you will get the
Spillable messages.

HTH,
Tanton

Search Discussions

Discussion Posts

Previous

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 6 of 12 | next ›
Discussion Overview
groupuser @
categoriespig, hadoop
postedMay 23, '08 at 5:52a
activeMay 30, '08 at 4:32p
posts12
users5
websitepig.apache.org

People

Translate

site design / logo © 2021 Grokbase