FAQ
Hi,
I'm reading Hadoop Definitive Guide book. I've tried to benchmark my hadoop
cluster. I got some results but when i compared them, i was shocked. Because
there were several interesting difference. I don't understand is it good or bad?
Please help me
Regards...

Writing Test
hadoop jar hadoop-0.20.2-test.jar TestDFSIO -write -nrFiles 10 -fileSize 1000
10/08/25 23:49:40 INFO mapred.FileInputFormat: ----- TestDFSIO ----- : write
10/08/25 23:49:40 INFO mapred.FileInputFormat: Date & time: Wed Aug
25 23:49:40 EEST 2010
10/08/25 23:49:40 INFO mapred.FileInputFormat: Number of files: 10
10/08/25 23:49:40 INFO mapred.FileInputFormat: Total MBytes processed: 10000
10/08/25 23:49:40 INFO mapred.FileInputFormat: Throughput mb/sec:
36.09482833299645
10/08/25 23:49:40 INFO mapred.FileInputFormat: Average IO rate mb/sec:
49.026153564453125
10/08/25 23:49:40 INFO mapred.FileInputFormat: IO rate std deviation:
22.15250292439401
10/08/25 23:49:40 INFO mapred.FileInputFormat: Test exec time sec: 175.537

Reading Test
hadoop jar hadoop-0.20.2-test.jar TestDFSIO -read -nrFiles 10 -fileSize 1000
10/08/25 23:54:11 INFO mapred.FileInputFormat: ----- TestDFSIO ----- : read
10/08/25 23:54:11 INFO mapred.FileInputFormat: Date & time: Wed Aug
25 23:54:11 EEST 2010
10/08/25 23:54:11 INFO mapred.FileInputFormat: Number of files: 10
10/08/25 23:54:11 INFO mapred.FileInputFormat: Total MBytes processed: 10000
10/08/25 23:54:11 INFO mapred.FileInputFormat: Throughput mb/sec:
152.87948510189418
10/08/25 23:54:11 INFO mapred.FileInputFormat: Average IO rate mb/sec:
152.8846893310547
10/08/25 23:54:11 INFO mapred.FileInputFormat: IO rate std deviation:
0.8895501092647955
10/08/25 23:54:11 INFO mapred.FileInputFormat: Test exec time sec: 61.618

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedAug 25, '10 at 9:12p
activeAug 25, '10 at 9:12p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Burak ISIKLI: 1 post

People

Translate

site design / logo © 2022 Grokbase