Hadoop > hdfs-dev > November 2010

See <https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/481/changes Changes: [hairong] HDFS-903. Support fsimage validation using MD5 checksum. Contributed by Hairong Kuang. ...

See <https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/493/changes Changes: [nigel] Fix bug in tar file name [nigel] Add some comments to commitBuild.sh and put artifacts in a single directory ...

Hi all, After reading the appenddesign3.pdf in HDFS-256, and looking at the BlockReceiver.java code in 0.21.0, I am confused by the following. The document says that: *For each packet, a DataNode in ...

See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-21-Build/129/ ################################################################################### ########################## LAST 60 LINES OF THE ...

----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27/ ...

See <https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/466/changes Changes: [hairong] HDFS-1481. NameNode should validate fsimage before rolling. Contributed by Hairong Kuang. ...

----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/105/ ...

See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/506/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Sure, moving this discussion to the public list. It was only a private discussion because I find people tend to notice messages in their inbox more than on JIRA or a list ;-) -Todd -- Todd Lipcon ...

TestStorageRestore is failing after HDFS-903 fix ------------------------------------------------ Key: HDFS-1496 URL: https://issues.apache.org/jira/browse/HDFS-1496 Project: Hadoop HDFS Issue Type: ...

See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-22-branch/1/ ################################################################################### ########################## LAST 60 LINES OF THE ...

----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/125/ ...

See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/474/ ################################################################################### ########################## LAST 60 LINES OF ...

Persist transaction ID on disk between NN restarts -------------------------------------------------- Key: HDFS-1521 URL: https://issues.apache.org/jira/browse/HDFS-1521 Project: Hadoop HDFS Issue ...

HDFS build is broken, ivy-resolve-common does not find hadoop-common -------------------------------------------------------------------- Key: HDFS-1519 URL: ...

Hi all, Is there any benchmarks for HDFS available) (measuring read/write throughput, latency and such). It would be great if somebody point me to any source. Thanks much Thanh

See <https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/463/ ------------------------------------------ [...truncated 2436 lines...] ivy-init: ivy-resolve-common: ivy-retrieve-common: ...

Hi all, Can somebody let me know what is this parameter used for: dfs.datanode.transferTo.allowed It is not in default config, and the maxChunksPerPacket depends on it. Thanks so much. Thanh

Hi all, When a datanode receive a block, the datanode write the block into 2 streams on disk: - the data stream (dataOut) - the checksum stream (checksumOut) While the checksumOut is created with ...

TransferFSImage should timeout ------------------------------ Key: HDFS-1490 URL: https://issues.apache.org/jira/browse/HDFS-1490 Project: Hadoop HDFS Issue Type: Bug Components: name-node Reporter: ...

breaking the dependency between FSEditLog and FSImage ----------------------------------------------------- Key: HDFS-1489 URL: https://issues.apache.org/jira/browse/HDFS-1489 Project: Hadoop HDFS ...

Test append and quotas ----------------------- Key: HDFS-1515 URL: https://issues.apache.org/jira/browse/HDFS-1515 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0, ...

98 Release Audit warnings on trunk and branch-0.22 -------------------------------------------------- Key: HDFS-1511 URL: https://issues.apache.org/jira/browse/HDFS-1511 Project: Hadoop HDFS Issue ...

HDFS 20 append: Lightweight NameNode operations to trigger lease recovery ------------------------------------------------------------------------- Key: HDFS-1520 URL: ...

TestBlockRecovery triggers NPE in assert ---------------------------------------- Key: HDFS-1502 URL: https://issues.apache.org/jira/browse/HDFS-1502 Project: Hadoop HDFS Issue Type: Bug Affects ...

TestSaveNamespace fails when FI is enabled ------------------------------------------ Key: HDFS-1503 URL: https://issues.apache.org/jira/browse/HDFS-1503 Project: Hadoop HDFS Issue Type: Bug ...

See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/504/ ################################################################################### ########################## LAST 60 LINES OF THE ...

mvn-install is broken after 0.22 branch creation ------------------------------------------------ Key: HDFS-1516 URL: https://issues.apache.org/jira/browse/HDFS-1516 Project: Hadoop HDFS Issue Type: ...

[ https://issues.apache.org/jira/browse/HDFS-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang resolved HDFS-1467. --------------------------------- Resolution: ...

Add test-patch.properties required by test-patch.sh --------------------------------------------------- Key: HDFS-1510 URL: https://issues.apache.org/jira/browse/HDFS-1510 Project: Hadoop HDFS Issue ...

TestAbandonBlock should abandon a block --------------------------------------- Key: HDFS-1507 URL: https://issues.apache.org/jira/browse/HDFS-1507 Project: Hadoop HDFS Issue Type: Bug Components: ...

Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903) ...

Nigel At my previous company we simply checked-in the .classpath file and the .project file rather then generate it through an ant command. Folks who were not using eclipse ignored it. Should we ...

Wrong description in FSNamesystem's javadoc ------------------------------------------- Key: HDFS-1518 URL: https://issues.apache.org/jira/browse/HDFS-1518 Project: Hadoop HDFS Issue Type: ...

We have a corrupted file which has only one block. It turns out that all checksum files of the replicas are corrupted... but the data files are OK... How to recover this file? I can think of trying ...

[ https://issues.apache.org/jira/browse/HDFS-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1162. ------------------------------------ ...

CLONE -mvn-install is broken after 0.22 branch creation ------------------------------------------------------- Key: HDFS-1517 URL: https://issues.apache.org/jira/browse/HDFS-1517 Project: Hadoop ...

project.version in aop.xml is out of sync with build.xml -------------------------------------------------------- Key: HDFS-1514 URL: https://issues.apache.org/jira/browse/HDFS-1514 Project: Hadoop ...

Fix a number of warnings ------------------------ Key: HDFS-1513 URL: https://issues.apache.org/jira/browse/HDFS-1513 Project: Hadoop HDFS Issue Type: Improvement Reporter: Eli Collins Assignee: Eli ...

BlockSender calls deprecated method getReplica ---------------------------------------------- Key: HDFS-1512 URL: https://issues.apache.org/jira/browse/HDFS-1512 Project: Hadoop HDFS Issue Type: ...

[ https://issues.apache.org/jira/browse/HDFS-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-1467: ------------------------------- Reopening, I'm ...

Resync discarded directories in fs.name.dir during saveNamespace command ------------------------------------------------------------------------ Key: HDFS-1509 URL: ...

Ability to do savenamespace without being in safemode ----------------------------------------------------- Key: HDFS-1508 URL: https://issues.apache.org/jira/browse/HDFS-1508 Project: Hadoop HDFS ...

[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-528. ------------------------------ Resolution: Fixed ...

Refator fsimage loading code ---------------------------- Key: HDFS-1506 URL: https://issues.apache.org/jira/browse/HDFS-1506 Project: Hadoop HDFS Issue Type: Improvement Components: name-node ...

saveNamespace appears to succeed even if all directories fail to save --------------------------------------------------------------------- Key: HDFS-1505 URL: ...

FSImageSaver should catch all exceptions, not just IOE ------------------------------------------------------ Key: HDFS-1504 URL: https://issues.apache.org/jira/browse/HDFS-1504 Project: Hadoop HDFS ...

[ https://issues.apache.org/jira/browse/HDFS-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-1374. ------------------------------- Resolution: Fixed ...

The logic that makes namenode exit safemode should be pluggable --------------------------------------------------------------- Key: HDFS-1501 URL: https://issues.apache.org/jira/browse/HDFS-1501 ...

[ https://issues.apache.org/jira/browse/HDFS-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-1055. ------------------------------- Resolution: Fixed ...