FAQ
Datanode behaves badly when one disk is very low on space
---------------------------------------------------------

Key: HDFS-788
URL: https://issues.apache.org/jira/browse/HDFS-788
Project: Hadoop HDFS
Issue Type: Bug
Components: data-node
Reporter: Todd Lipcon


FSDataset.getNextVolume() uses FSVolume.getAvailable() to determine whether to allocate a block on a volume. This doesn't factor in other in-flight blocks that have been "promised" space on the volume. The resulting issue is that, if a volume is nearly full but not full, multiple blocks will be allocated on that volume, and then they will all hit "Out of space" errors during the write.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-dev @
categorieshadoop
postedNov 28, '09 at 4:56a
activeNov 28, '09 at 4:56a
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Todd Lipcon (JIRA): 1 post

People

Translate

site design / logo © 2023 Grokbase