FAQ
reduce namenode startup time by optimising checkBlockInfo while loading fsimage
---------------------------------------------------------------------------------

Key: HDFS-1366
URL: https://issues.apache.org/jira/browse/HDFS-1366
Project: Hadoop HDFS
Issue Type: Improvement
Components: name-node
Reporter: dhruba borthakur


The namenode spends about 10 minutes reading in a 14 GB fsimage file into memory and creating all the in-memory data structures. A jstack based debugger clearly shows that most of the time during the fsimage load is spent in BlocksMap.checkBlockInfo. There is a easy way to optimize this method especially for this code path.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
categorieshadoop
postedSep 2, '10 at 5:35a
activeSep 2, '10 at 5:35a
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

dhruba borthakur (JIRA): 1 post

People

Translate

site design / logo © 2022 Grokbase