I thought that as long as I specified neither -client nor -server, that
Server Class detection would automatically invoke the "-server" option.


We are running 12-core AMD Opteron which is AMD64, so according to the
guide above, -server is selected automatically. Please let me know if
I've misunderstood this. We *definitely* want to be running hotspot!
It's two different JVMs, not a matter of using -client or -server
(which are just different configurations). What you are running is:


What most people run is:

Regarding GC: we are generating GC logs for namenode, datanode, master
and regionserver. We do see long GC from time to time. In fact, I played
with the mslab option, but didn't find significant improvement. We've
seen times on the order of a minute in these logs, and have found no way
around it (spent countless days and nights experimenting with different
GC parameters, mslab, different heap sizes, etc).
Sometimes it's just a matter of how much data you have in flight.
That's why I mentioned scanner pre-caching (set via Scan.setCaching),
because it can potentially load a lot of rows into the RS's heap. More
concurrent scanners means also more data loaded into memory.

Are you also inserting at the same time? What's your write buffer size?

The discussion in this jira could be relevant:

A temporary fix got committed in 0.90.3 to make
ipc.server.max.queue.size configurable.


Search Discussions

Discussion Posts


Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 12 of 40 | next ›
Discussion Overview
groupuser @
categorieshbase, hadoop
postedSep 11, '11 at 12:51a
activeSep 14, '11 at 5:43p



site design / logo © 2018 Grokbase