BlockSender should compare on disk file length with replica length instead of replica visible length.

Key: HDFS-698
URL: https://issues.apache.org/jira/browse/HDFS-698
Project: Hadoop HDFS
Issue Type: Bug
Components: data-node
Affects Versions: 0.21.0
Reporter: Konstantin Shvachko
Fix For: 0.21.0

BlockSender waits until all bytes of a replica are flushed to disk. Currently it compares the replica bytes on disk with the replica visible length. In order to make sure that *all* bytes are flushed it should compare the bytes on disk with the block length, because visible length may be smaller than the block length.
It would be useful also to create a special method FSDataset.getBytesOnDisk(blockID), which gets this information through the volume map. Otherwise we may access replicas, which are not in the map anymore.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
postedOct 12, '09 at 9:58p
activeOct 12, '09 at 9:58p

1 user in discussion

Konstantin Shvachko (JIRA): 1 post



site design / logo © 2022 Grokbase