I thought that as long as I specified neither -client nor -server, that
Server Class detection would automatically invoke the "-server" option.
http://download.oracle.com/javase/6/docs/technotes/guides/vm/server-clas
s.html
We are running 12-core AMD Opteron which is AMD64, so according to the
guide above, -server is selected automatically. Please let me know if
I've misunderstood this. We *definitely* want to be running hotspot!
Server Class detection would automatically invoke the "-server" option.
http://download.oracle.com/javase/6/docs/technotes/guides/vm/server-clas
s.html
We are running 12-core AMD Opteron which is AMD64, so according to the
guide above, -server is selected automatically. Please let me know if
I've misunderstood this. We *definitely* want to be running hotspot!
(which are just different configurations). What you are running is:
http://openjdk.java.net/
What most people run is:
http://www.oracle.com/us/technologies/java/index.html
Regarding GC: we are generating GC logs for namenode, datanode, master
and regionserver. We do see long GC from time to time. In fact, I played
with the mslab option, but didn't find significant improvement. We've
seen times on the order of a minute in these logs, and have found no way
around it (spent countless days and nights experimenting with different
GC parameters, mslab, different heap sizes, etc).
Sometimes it's just a matter of how much data you have in flight.and regionserver. We do see long GC from time to time. In fact, I played
with the mslab option, but didn't find significant improvement. We've
seen times on the order of a minute in these logs, and have found no way
around it (spent countless days and nights experimenting with different
GC parameters, mslab, different heap sizes, etc).
That's why I mentioned scanner pre-caching (set via Scan.setCaching),
because it can potentially load a lot of rows into the RS's heap. More
concurrent scanners means also more data loaded into memory.
Are you also inserting at the same time? What's your write buffer size?
The discussion in this jira could be relevant:
https://issues.apache.org/jira/browse/HBASE-3813
A temporary fix got committed in 0.90.3 to make
ipc.server.max.queue.size configurable.
J-D
