Hi all,

I have installed CDH3 in my cluster using Cloudera Manager and found that
the values of certain Hadoop metrics are not quivalent to the
"hdfs-default.xml" & "mapred-default.xml" (i.e., they are not equivalent to
the default values given by "hdfs-default.xaml" & "mapred-default.xml")

Following are some of the metrics along with their values (installed from
Cloudera Manager):

dfs.block.size = 128MB (default should be 64MB)
mapred.child.java.opts = 474.22MB (default should be 200MB)
io.sort.mb = 118MB (default should be 100MB)
mapred.reduce.parallel.copies = 10 (default should be 5)

Above are some of the properties which I found different that what it
should be as the default value.

My question is that how & why Cloudera Manager configures the default
cluster. Why these values are different when Hadoop is installed using
Cloudera Manager.
Will these values differ if I install CDH3 using Cloudera Manager in some
other cluster of different size and hardware configuration? (I mean dows
cloudera manager instantly decide while installing, how to configure Hadoop
depending on the cluster environment?)

Can someone please explain this?

Gaurav Dasgupta

Search Discussions

Discussion Posts

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 1 of 2 | next ›
Discussion Overview
groupscm-users @
postedSep 5, '12 at 10:19a
activeSep 5, '12 at 3:51p



site design / logo © 2022 Grokbase