Provide a stronger data guarantee in the write pipeline

Key: HDFS-1606
URL: https://issues.apache.org/jira/browse/HDFS-1606
Project: Hadoop HDFS
Issue Type: New Feature
Components: data-node, hdfs client
Reporter: Tsz Wo (Nicholas), SZE

In the current design, if there is a datanode/network failures in the write pipeline, DFSClient will try to remove the failed datanode from the pipeline and then continue writing with the remaining datanodes. As a result, the number of datanodes in the pipeline is decreased. Unfortunately, it is possible that DFSClient may incorrectly remove a healthy datanode but leave the failed datanode in the pipeline because failure detection may not be accurate under erroneous conditions.

We propose to add a new mechanism for adding new datanodes to the pipeline in order to provide a stronger data guarantee.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
postedJan 31, '11 at 11:42p
activeJan 31, '11 at 11:42p

1 user in discussion

Tsz Wo (Nicholas), SZE (JIRA): 1 post



site design / logo © 2022 Grokbase