Enhance NNThroughputBenchmark to observe scale-dependent changes in IBR processing

Key: HDFS-1732
URL: https://issues.apache.org/jira/browse/HDFS-1732
Project: Hadoop HDFS
Issue Type: Improvement
Components: name-node
Affects Versions: 0.22.0
Reporter: Matt Foley
Assignee: Matt Foley

Rework NNThroughputBenchmark to provide more detailed info about Initial Block Report (IBR) processing time, as a function of number of nodes, number of unique blocks, and total number of replicas.

Allow both direct local communication and remote and local RPC, so we can see how much impact RPC overhead has on IBR processing time.

Also plug some holes in performance-specific logging of Block Report processing, so that consistent and complete data are logged from both Namenode and Datanode.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
postedMar 8, '11 at 3:02a
activeMar 8, '11 at 3:02a

1 user in discussion

Matt Foley (JIRA): 1 post



site design / logo © 2022 Grokbase