Synchronization other FSNamesystem information to BackupNode

Key: HDFS-893
URL: https://issues.apache.org/jira/browse/HDFS-893
Project: Hadoop HDFS
Issue Type: New Feature
Components: name-node
Reporter: Wang Xu

Backup Node (BN) in trunk brings "warm" standby (HADOOP-4539), it synchronizes namespace information from Main NameNode, and leaves DataNode information, Block Operation (such as replication), and lease information unsynchronized.

We (team from China Mobile Research Instatitute) had also some experimental on Namesystem schronization ( some information has been post at: http://gnawux.info/hadoop/2010/01/pratice-of-namenode-cluster-for-hdfs-ha/ ). Currently, we are thinking about migrate our code to re-based on Backup Node, and we think it might convenience the maintenance of code and contributing back to community.

As NN in current trunk can log all the namespace changes as journals to BN, the rest information needed to be synchronized includes:

- Changes in DataNode Map: information collected from DataNode heartbeats and reports. Together with namespace info, the blocks map can also be calculated.
- Lease information: leases are updated by clients periodically or when it lock/unlock file for write.
- Block operation's status, such as pending replication block list: these information are depends on random number, thus it may lead to inconsistency if do not synchronize them.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
postedJan 12, '10 at 3:18p
activeJan 12, '10 at 3:18p

1 user in discussion

Wang Xu (JIRA): 1 post



site design / logo © 2022 Grokbase