hdfs-dev@hadoop.apache.org discussions for April 2011

36	[Discuss] Merge federation branch HDFS-1052 into trunk

A few weeks ago, I had sent an email about the progress of HDFS federation development in HDFS-1052 branch. I am happy to announce that all the tasks related to this feature development is complete ...

Suresh Srinivas
Apr 22, 2011 at 4:49 pm
May 3, 2011 at 2:17 am

12	Hadoop-Hdfs-trunk - Build # 630 - Still Failing

See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/630/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Hudson Server
Apr 7, 2011 at 12:32 pm
Apr 19, 2011 at 1:22 pm

6	Hadoop-Hdfs-trunk - Build # 652 - Failure

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/652/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Jenkins Server
Apr 30, 2011 at 12:43 pm
May 6, 2011 at 1:00 pm

4	Hadoop-Hdfs-trunk-Commit - Build # 614 - Failure

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/614/ ################################################################################### ########################## LAST 60 LINES OF ...

Apache Jenkins Server
Apr 29, 2011 at 6:32 pm
May 3, 2011 at 12:22 am

4	Hadoop-Hdfs-trunk - Build # 645 - Failure

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/645/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Jenkins Server
Apr 23, 2011 at 12:33 pm
Apr 27, 2011 at 12:22 pm

4	hdfsproxy tests

Hi all, The hdfsproxy TestAuthorizationFilter test has been failing now for quite a long time. Can anyone familiar with this code step up and fix it? There s a JIRA at HDFS-1666. If no one volunteers ...

Todd Lipcon
Apr 4, 2011 at 5:15 pm
Apr 7, 2011 at 2:23 am

3	Hadoop-Hdfs-22-branch - Build # 36 - Failure

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-22-branch/36/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Jenkins Server
Apr 26, 2011 at 11:25 am
May 6, 2011 at 11:33 am

3	[jira] [Created] (HDFS-1799) Refactor log rolling and filename management out of FSEditLog

Refactor log rolling and filename management out of FSEditLog ------------------------------------------------------------- Key: HDFS-1799 URL: https://issues.apache.org/jira/browse/HDFS-1799 ...

Todd Lipcon (JIRA)
Apr 1, 2011 at 5:38 am
May 5, 2011 at 10:35 pm

3	silent data loss during append

Hi all, I have recently seen silent data loss in our system. Here is the case: 1. client appends to some block 2. for some reason, commitBlockSynchronization returns successfully with synclist = [] ...

Thanh Do
Apr 14, 2011 at 10:56 pm
Apr 15, 2011 at 4:54 pm

3	[jira] [Created] (HDFS-1813) Authentication using BlockToken in RPC to datanode fails.

Authentication using BlockToken in RPC to datanode fails. --------------------------------------------------------- Key: HDFS-1813 URL: https://issues.apache.org/jira/browse/HDFS-1813 Project: Hadoop ...

Jitendra Nath Pandey (JIRA)
Apr 7, 2011 at 1:29 am
Apr 8, 2011 at 8:05 pm

2	[jira] [Created] (HDFS-1836) Thousand of CLOSE_WAIT socket

Thousand of CLOSE_WAIT socket ------------------------------ Key: HDFS-1836 URL: https://issues.apache.org/jira/browse/HDFS-1836 Project: Hadoop HDFS Issue Type: Bug Components: hdfs client Affects ...

Dennis Cheung (JIRA)
Apr 14, 2011 at 7:41 am
Jun 15, 2011 at 12:05 am

2	[jira] [Created] (HDFS-1828) TestBlocksWithNotEnoughRacks intermittently fails assert

TestBlocksWithNotEnoughRacks intermittently fails assert -------------------------------------------------------- Key: HDFS-1828 URL: https://issues.apache.org/jira/browse/HDFS-1828 Project: Hadoop ...

Matt Foley (JIRA)
Apr 12, 2011 at 4:29 am
May 23, 2011 at 5:18 pm

2	[jira] [Created] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

Editlog opcodes overlap between 20 security and later releases -------------------------------------------------------------- Key: HDFS-1822 URL: https://issues.apache.org/jira/browse/HDFS-1822 ...

Suresh Srinivas (JIRA)
Apr 8, 2011 at 7:59 pm
Apr 25, 2011 at 7:35 pm

2	Need Help with HDFS Build Failure

Hi, I'm an HDFS newbie. I'm trying to learn more about HDFS by doing a student project. Ive been facing build breaks since today with the error messages: ...

Amit Gupta
Apr 17, 2011 at 12:37 am
Apr 17, 2011 at 8:31 am

1	[jira] [Created] (HDFS-1863) When all data directory volumes pulled out in DataNode, Its better to shutdown.

When all data directory volumes pulled out in DataNode, Its better to shutdown. ------------------------------------------------------------------------------- Key: HDFS-1863 URL: ...

Brahma (JIRA)
Apr 26, 2011 at 4:27 pm
Jan 7, 2012 at 5:10 pm

1	[jira] [Created] (HDFS-1810) Remove duplicate jar entries from common

Remove duplicate jar entries from common ---------------------------------------- Key: HDFS-1810 URL: https://issues.apache.org/jira/browse/HDFS-1810 Project: Hadoop HDFS Issue Type: Improvement ...

Owen O'Malley (JIRA)
Apr 5, 2011 at 11:16 pm
Aug 19, 2011 at 5:42 pm

1	[jira] [Created] (HDFS-1815) Add migration tests from old-format to new-format storage

Add migration tests from old-format to new-format storage --------------------------------------------------------- Key: HDFS-1815 URL: https://issues.apache.org/jira/browse/HDFS-1815 Project: Hadoop ...

Todd Lipcon (JIRA)
Apr 7, 2011 at 3:38 am
Jun 21, 2011 at 10:48 pm

1	[jira] [Created] (HDFS-1811) Create scripts to decommission datanodes

Create scripts to decommission datanodes ---------------------------------------- Key: HDFS-1811 URL: https://issues.apache.org/jira/browse/HDFS-1811 Project: Hadoop HDFS Issue Type: Improvement ...

Owen O'Malley (JIRA)
Apr 5, 2011 at 11:40 pm
Jun 15, 2011 at 8:41 pm

1	[jira] [Created] (HDFS-1800) Extend image checksumming to function with multiple fsimage files

Extend image checksumming to function with multiple fsimage files ----------------------------------------------------------------- Key: HDFS-1800 URL: https://issues.apache.org/jira/browse/HDFS-1800 ...

Todd Lipcon (JIRA)
Apr 1, 2011 at 9:05 pm
May 13, 2011 at 3:35 am

1	[jira] [Created] (HDFS-1801) Remove use of timestamps to identify checkpoints and logs

Remove use of timestamps to identify checkpoints and logs --------------------------------------------------------- Key: HDFS-1801 URL: https://issues.apache.org/jira/browse/HDFS-1801 Project: Hadoop ...

Todd Lipcon (JIRA)
Apr 1, 2011 at 10:41 pm
May 9, 2011 at 12:33 am

1	[jira] [Created] (HDFS-1860) when renewing/canceling DelegationToken over http we need to pass exception information back to the caller.

when renewing/canceling DelegationToken over http we need to pass exception information back to the caller. ...

Boris Shkolnik (JIRA)
Apr 22, 2011 at 6:33 pm
May 2, 2011 at 9:35 pm

1	[jira] [Created] (HDFS-1867) Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists

Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists ...

Tanping Wang (JIRA)
Apr 28, 2011 at 9:46 pm
May 2, 2011 at 9:25 pm

1	[jira] [Created] (HDFS-1871) Tests using MiniDFSCluster fail to compile due to HDFS-1052 changes

Tests using MiniDFSCluster fail to compile due to HDFS-1052 changes ------------------------------------------------------------------- Key: HDFS-1871 URL: ...

Suresh Srinivas (JIRA)
Apr 29, 2011 at 9:55 pm
Apr 29, 2011 at 10:11 pm

1	[jira] [Created] (HDFS-1864) Hadoop Namenode not starting up.

Hadoop Namenode not starting up. -------------------------------- Key: HDFS-1864 URL: https://issues.apache.org/jira/browse/HDFS-1864 Project: Hadoop HDFS Issue Type: Task Reporter: Ronak Shah 1. ...

Ronak Shah (JIRA)
Apr 26, 2011 at 6:31 pm
Apr 27, 2011 at 4:41 am

1	run pig on hadoop

Hi, when I do this: $PATH/bin/hadoop dfs -copyFromLocal [fileLocal] [fileHDFS] I have my fileLocal but I don't know how I find fileHDFS, I like to know the path ? and thank you

Hiba houimli
Apr 25, 2011 at 11:25 pm
Apr 26, 2011 at 2:13 am

1	Queries about HDFS block migration

Hi, Ive been trying to understand how the Balancer class works. I know the basics about the threshold guidelines and the general motivations of running the balancer. I had a few questions about block ...

Amit Gupta
Apr 23, 2011 at 11:30 pm
Apr 24, 2011 at 2:43 pm

1	[jira] [Created] (HDFS-1842) Cannot upgrade 0.20.203 to 0.21 with an editslog present

Cannot upgrade 0.20.203 to 0.21 with an editslog present -------------------------------------------------------- Key: HDFS-1842 URL: https://issues.apache.org/jira/browse/HDFS-1842 Project: Hadoop ...

Allen Wittenauer (JIRA)
Apr 15, 2011 at 11:22 pm
Apr 22, 2011 at 11:12 pm

1	[jira] [Created] (HDFS-1859) Add some convenience functions to iterate over edit log streams

Add some convenience functions to iterate over edit log streams --------------------------------------------------------------- Key: HDFS-1859 URL: https://issues.apache.org/jira/browse/HDFS-1859 ...

Todd Lipcon (JIRA)
Apr 22, 2011 at 5:35 am
Apr 22, 2011 at 5:39 am

1	[jira] [Created] (HDFS-1858) Add state management variables to FSEditLog

Add state management variables to FSEditLog ------------------------------------------- Key: HDFS-1858 URL: https://issues.apache.org/jira/browse/HDFS-1858 Project: Hadoop HDFS Issue Type: Sub-task ...

Todd Lipcon (JIRA)
Apr 22, 2011 at 5:31 am
Apr 22, 2011 at 5:33 am

1	Hadoop-Hdfs-trunk-Commit - Build # 598 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/598/ ################################################################################### ########################## LAST 60 LINES OF ...

Apache Hudson Server
Apr 19, 2011 at 1:47 pm
Apr 21, 2011 at 6:40 pm

1	[jira] [Created] (HDFS-1849) Respect failed.volumes.tolerated on startup

Respect failed.volumes.tolerated on startup ------------------------------------------- Key: HDFS-1849 URL: https://issues.apache.org/jira/browse/HDFS-1849 Project: Hadoop HDFS Issue Type: ...

Eli Collins (JIRA)
Apr 20, 2011 at 12:06 am
Apr 21, 2011 at 4:36 pm

1	Datanode Heartbeat Error Messages

Hi, Upon launching the Namenode and Datanodes, I seem to be getting the following error messages (on freshly checkedout and built code) at a datanode: * (In the ...

Amit Gupta
Apr 20, 2011 at 6:47 am
Apr 20, 2011 at 8:21 am

1	Hadoop-Hdfs-trunk-Commit - Build # 585 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/585/ ################################################################################### ########################## LAST 60 LINES OF ...

Apache Hudson Server
Apr 8, 2011 at 5:11 am
Apr 8, 2011 at 5:42 pm

1	[jira] [Created] (HDFS-1819) TestDFSShell is failing on trunk

TestDFSShell is failing on trunk -------------------------------- Key: HDFS-1819 URL: https://issues.apache.org/jira/browse/HDFS-1819 Project: Hadoop HDFS Issue Type: Bug Components: test Affects ...

Aaron T. Myers (JIRA)
Apr 8, 2011 at 5:57 am
Apr 8, 2011 at 5:59 am

0	[jira] [Created] (HDFS-1873) Federation Cluster Management Web Console

Federation Cluster Management Web Console ----------------------------------------- Key: HDFS-1873 URL: https://issues.apache.org/jira/browse/HDFS-1873 Project: Hadoop HDFS Issue Type: New Feature ...

Tanping Wang (JIRA)
Apr 30, 2011 at 12:59 am
Apr 30, 2011 at 12:59 am

0	[jira] [Created] (HDFS-1872) BPOfferService.cleanUp(..) throws NullPointerException

BPOfferService.cleanUp(..) throws NullPointerException ------------------------------------------------------ Key: HDFS-1872 URL: https://issues.apache.org/jira/browse/HDFS-1872 Project: Hadoop HDFS ...

Tsz Wo (Nicholas), SZE (JIRA)
Apr 29, 2011 at 11:15 pm
Apr 29, 2011 at 11:15 pm

0	[jira] [Created] (HDFS-1870) Refactor DFSClient.LeaseChecker

Refactor DFSClient.LeaseChecker ------------------------------- Key: HDFS-1870 URL: https://issues.apache.org/jira/browse/HDFS-1870 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs ...

Tsz Wo (Nicholas), SZE (JIRA)
Apr 29, 2011 at 8:39 pm
Apr 29, 2011 at 8:39 pm

0	[jira] [Created] (HDFS-1869) mkdirs should use the supplied permission for all of the created directories

mkdirs should use the supplied permission for all of the created directories ---------------------------------------------------------------------------- Key: HDFS-1869 URL: ...

Daryn Sharp (JIRA)
Apr 29, 2011 at 8:37 pm
Apr 29, 2011 at 8:37 pm

0	[jira] [Created] (HDFS-1868) HDFS-client may block shutdown of JVM

HDFS-client may block shutdown of JVM ------------------------------------- Key: HDFS-1868 URL: https://issues.apache.org/jira/browse/HDFS-1868 Project: Hadoop HDFS Issue Type: Bug Components: hdfs ...

Dennis Cheung (JIRA)
Apr 29, 2011 at 3:48 am
Apr 29, 2011 at 3:48 am

0	[jira] [Resolved] (HDFS-1414) HDFS federation : fix unit test cases

[ https://issues.apache.org/jira/browse/HDFS-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1414. ----------------------------------- ...

Suresh Srinivas (JIRA)
Apr 28, 2011 at 9:25 pm
Apr 28, 2011 at 9:25 pm

0	[jira] [Resolved] (HDFS-1398) HDFS federation: Upgrade and rolling back of Federation

[ https://issues.apache.org/jira/browse/HDFS-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1398. ----------------------------------- ...

Suresh Srinivas (JIRA)
Apr 28, 2011 at 9:25 pm
Apr 28, 2011 at 9:25 pm

0	[jira] [Resolved] (HDFS-1397) HDFS federation: Storage directory of VERSION(/ID) file

[ https://issues.apache.org/jira/browse/HDFS-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1397. ----------------------------------- ...

Suresh Srinivas (JIRA)
Apr 28, 2011 at 9:23 pm
Apr 28, 2011 at 9:23 pm

0	[jira] [Created] (HDFS-1866) Document dfs.datanode.max.transfer.threads in hdfs-default.xml

Document dfs.datanode.max.transfer.threads in hdfs-default.xml -------------------------------------------------------------- Key: HDFS-1866 URL: https://issues.apache.org/jira/browse/HDFS-1866 ...

Eli Collins (JIRA)
Apr 27, 2011 at 6:20 pm
Apr 27, 2011 at 6:20 pm

0	[jira] [Created] (HDFS-1865) Share LeaseChecker thread among DFSClients

Share LeaseChecker thread among DFSClients ------------------------------------------ Key: HDFS-1865 URL: https://issues.apache.org/jira/browse/HDFS-1865 Project: Hadoop HDFS Issue Type: Improvement ...

Tsz Wo (Nicholas), SZE (JIRA)
Apr 27, 2011 at 4:31 am
Apr 27, 2011 at 4:31 am

0	[jira] [Created] (HDFS-1862) Improve test reliability of HDFS-1594

Improve test reliability of HDFS-1594 ------------------------------------- Key: HDFS-1862 URL: https://issues.apache.org/jira/browse/HDFS-1862 Project: Hadoop HDFS Issue Type: Test Components: test ...

Aaron T. Myers (JIRA)
Apr 25, 2011 at 10:22 pm
Apr 25, 2011 at 10:22 pm

0	[jira] [Created] (HDFS-1861) Rename dfs.datanode.max.xcievers and bump it's default value

Rename dfs.datanode.max.xcievers and bump it's default value ------------------------------------------------------------ Key: HDFS-1861 URL: https://issues.apache.org/jira/browse/HDFS-1861 Project: ...

Eli Collins (JIRA)
Apr 23, 2011 at 6:51 am
Apr 23, 2011 at 6:51 am

0	[jira] [Resolved] (HDFS-243) Namenode cluster(multi namenode working in active-active mode) to keep high availability and expansivity

[ https://issues.apache.org/jira/browse/HDFS-243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-243. ------------------------------ Resolution: ...

Eli Collins (JIRA)
Apr 21, 2011 at 5:11 pm
Apr 21, 2011 at 5:11 pm

0	[jira] [Created] (HDFS-1857) Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL: http://java.sun.com/javase/6/docs/api/package-list

Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL: http://java.sun.com/javase/6/docs/api/package-list ...

Matt Foley (JIRA)
Apr 21, 2011 at 4:34 pm
Apr 21, 2011 at 4:34 pm

0	[jira] [Created] (HDFS-1856) TestDatanodeBlockScanner waits forever, errs without giving information

TestDatanodeBlockScanner waits forever, errs without giving information ----------------------------------------------------------------------- Key: HDFS-1856 URL: ...

Matt Foley (JIRA)
Apr 21, 2011 at 7:32 am
Apr 21, 2011 at 7:32 am

0	[jira] [Created] (HDFS-1855) TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy() part 2 fails in two different ways

TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy() part 2 fails in two different ways ----------------------------------------------------------------------------------------------- Key: ...

Matt Foley (JIRA)
Apr 21, 2011 at 7:11 am
Apr 21, 2011 at 7:11 am

group	hdfs-dev @
categories	hadoop
discussions	101
posts	204
users	27
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > hdfs-dev > April 2011

Search Discussions

101 discussions - 204 posts

27 users for April 2011

Content

People

Support

Translate