FAQ
Enhance NNThroughputBenchmark to observe scale-dependent changes in IBR processing
----------------------------------------------------------------------------------

Key: HDFS-1732
URL: https://issues.apache.org/jira/browse/HDFS-1732
Project: Hadoop HDFS
Issue Type: Improvement
Components: name-node
Affects Versions: 0.22.0
Reporter: Matt Foley
Assignee: Matt Foley


Rework NNThroughputBenchmark to provide more detailed info about Initial Block Report (IBR) processing time, as a function of number of nodes, number of unique blocks, and total number of replicas.

Allow both direct local communication and remote and local RPC, so we can see how much impact RPC overhead has on IBR processing time.

Also plug some holes in performance-specific logging of Block Report processing, so that consistent and complete data are logged from both Namenode and Datanode.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
categorieshadoop
postedMar 8, '11 at 3:02a
activeMar 8, '11 at 3:02a
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Matt Foley (JIRA): 1 post

People

Translate

site design / logo © 2022 Grokbase