hdfs-dev@hadoop.apache.org discussions for June 2011

9	Hadoop-Hdfs-trunk-Commit - Build # 717 - Failure

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/717/ ################################################################################### ########################## LAST 60 LINES OF ...

Apache Jenkins Server
Jun 6, 2011 at 9:48 pm
Jun 9, 2011 at 6:34 pm

8	Where did hdfs source go?

Hi folks, Where did the hdfs source go? http://wiki.apache.org/hadoop/HowToContribute doesn't work anymore. Trying $ svn checkout http://svn.apache.org/repos/asf/hadoop/hdfs/trunk/hadoop-hdfs-trunk ...

Ravi Prakash
Jun 13, 2011 at 7:14 am
Jun 17, 2011 at 10:58 pm

7	Hadoop-Hdfs-trunk-Commit - Build # 731 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/731/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Jenkins Server
Jun 10, 2011 at 6:14 pm
Jun 12, 2011 at 6:55 am

6	Hadoop-Hdfs-trunk - Build # 690 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/690/ ################################################################################### ########################## LAST 60 LINES OF THE CONSOLE ...

Apache Jenkins Server
Jun 7, 2011 at 12:35 pm
Jun 13, 2011 at 12:41 pm

5	How to run HDFS from source?

Hi, I have clone the repo for hadoop-common and hadoop-hdfs and built it using "ant mvn-install" . Now I would like to be able run HDFS in pseudo-distributed mode to test some modifications of mine. ...

André Oriani
Jun 7, 2011 at 6:57 pm
Jun 17, 2011 at 4:29 pm

4	Issue of FSImage, need help

Hi, Team, What we found when we use the Hadoop is, the FSImage often currupts when we do start/stop the Hadoop cluster. The reason we think might be around the write to the outputstream: the NameNode ...

Mac fang
Jun 28, 2011 at 8:45 am
Jul 4, 2011 at 5:07 am

4	Problem with BackupNode?

Hi, My repo is one week old and the change I did was to modify the Configuration object at BackupNode.initialize() to make the name and edit dirs to other directories, so I could run both namenode ...

André Oriani
Jun 15, 2011 at 10:43 pm
Jun 21, 2011 at 2:15 am

4	Hadoop-Hdfs-trunk-Commit - Build # 741 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/741/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Jenkins Server
Jun 13, 2011 at 3:15 am
Jun 15, 2011 at 9:53 pm

3	libhdfs compilation error with fresh checkout

Hi all, With a fresh checkout, running `ant binary` generates this error: create-libhdfs-configure: [mkdir] Created dir: /tmp/test/hadoop-hdfs/src/c++/libhdfs/config [exec] configure.ac:116: error: ...

Kirk True
Jun 6, 2011 at 4:06 pm
Jun 7, 2011 at 5:03 am

3	CLASSPATH errors running unit tests via Eclipse

Hi all, I'm trying to run some of the unit tests within Eclipse. But with a fresh checkout of the HDFS source, unit tests that use webapps generate errors in Eclipse. Steps to reproduce: 1. Get ...

Kirk True
Jun 6, 2011 at 4:02 pm
Jun 7, 2011 at 4:38 am

2	Hadoop-Hdfs-22-branch - Build # 68 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-22-branch/68/ ################################################################################### ########################## LAST 60 LINES OF THE CONSOLE ...

Apache Jenkins Server
Jun 15, 2011 at 11:40 pm
Jul 8, 2011 at 11:38 pm

2	Re: Developer meetup after the Hadoop Summit - Friday July 1st

I have updated meetup: http://www.meetup.com/Hadoop-Contributors/events/23890191/ sanjay

Sanjay Radia
Jun 28, 2011 at 11:43 pm
Jun 29, 2011 at 6:54 pm

2	Number of bytes per checksum

Hi, Why is the checksum done for io.bytes.per.checksum (defaults to 512) instead of the complete block at once (dfs.block.size defaults to 67108864)? If a block is corrupt then the entire block has ...

Praveen Sripati
Jun 24, 2011 at 2:25 pm
Jun 24, 2011 at 3:00 pm

2	How to build facebook-hadoop?

hi,all I'd like to try avatarnode, and I have download facebook-hadoop from https://github.com/facebook/hadoop-20-warehouse using git clone git://github.com/facebook/hadoop-20-warehouse.git How can I ...

MattDeans
Jun 14, 2011 at 9:14 am
Jun 15, 2011 at 1:34 am

2	Why LightWeightGSet ?

Hi, I was just going thru the implementation of LightWeightGSet and i figured LightWeightGSet implementation is pretty much the same as that of a HashMap execept for the fact that HashMap resizes ...

Akash Ashok
Jun 13, 2011 at 1:55 pm
Jun 13, 2011 at 4:24 pm

2	TestHDFSCLI is broken

Hey guys, TestHDFSCLI is failing on trunk. It's been failing for several days (so it's not HDFS-494). https://builds.apache.org/job/Hadoop-Hdfs-trunk/lastCompletedBuild/testReport Is anyone looking ...

Eli Collins
Jun 9, 2011 at 10:33 pm
Jun 10, 2011 at 4:59 pm

2	Hadoop-Hdfs-trunk-Commit - Build # 701 - Still Failing

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/701/ ################################################################################### ########################## LAST 60 LINES OF ...

Apache Jenkins Server
Jun 1, 2011 at 11:38 pm
Jun 2, 2011 at 2:53 am

2

snapshot

hi all, is there any work on snapshoting HDFS going on? Can anybody give me some hint on what the current state of the art in HDFS snapshoting. thanks a lot.

Thanh Do
Jun 1, 2011 at 2:04 am
Jun 1, 2011 at 7:40 pm

1	[jira] [Created] (HDFS-2051) TestBlockRecovery.testErrorReplicas is timing out

TestBlockRecovery.testErrorReplicas is timing out ------------------------------------------------- Key: HDFS-2051 URL: https://issues.apache.org/jira/browse/HDFS-2051 Project: Hadoop HDFS Issue ...

Eli Collins (JIRA)
Jun 8, 2011 at 5:06 pm
Sep 18, 2012 at 5:06 pm

1	[jira] [Created] (HDFS-2033) JIRA to redesign client side read path

JIRA to redesign client side read path -------------------------------------- Key: HDFS-2033 URL: https://issues.apache.org/jira/browse/HDFS-2033 Project: Hadoop HDFS Issue Type: Bug Reporter: John ...

John George (JIRA)
Jun 4, 2011 at 4:35 am
May 11, 2012 at 3:45 pm

1	[jira] [Created] (HDFS-2079) 1073: create an escape hatch to ignore startup consistency problems

1073: create an escape hatch to ignore startup consistency problems ------------------------------------------------------------------- Key: HDFS-2079 URL: ...

Todd Lipcon (JIRA)
Jun 16, 2011 at 11:52 pm
Feb 27, 2012 at 8:37 pm

1	[jira] [Created] (HDFS-2060) DFS client RPCs using protobufs

DFS client RPCs using protobufs ------------------------------- Key: HDFS-2060 URL: https://issues.apache.org/jira/browse/HDFS-2060 Project: Hadoop HDFS Issue Type: New Feature Affects Versions: ...

Todd Lipcon (JIRA)
Jun 10, 2011 at 5:40 pm
Feb 11, 2012 at 1:27 am

1	[jira] [Created] (HDFS-2080) Speed up DFS read path

Speed up DFS read path ---------------------- Key: HDFS-2080 URL: https://issues.apache.org/jira/browse/HDFS-2080 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs client Affects ...

Todd Lipcon (JIRA)
Jun 17, 2011 at 8:53 am
Nov 3, 2011 at 7:02 am

1	[jira] [Created] (HDFS-2053) NameNode detects "Inconsistent diskspace" for directories with quota-enabled subdirectories (introduced by HDFS-1377)

NameNode detects "Inconsistent diskspace" for directories with quota-enabled subdirectories (introduced by HDFS-1377) ...

Michael Noll (JIRA)
Jun 9, 2011 at 11:45 am
Aug 2, 2011 at 12:01 am

1	[jira] [Created] (HDFS-2104) 1073: Add a flag to 2NN to format its checkpoint dirs on startup

1073: Add a flag to 2NN to format its checkpoint dirs on startup ---------------------------------------------------------------- Key: HDFS-2104 URL: https://issues.apache.org/jira/browse/HDFS-2104 ...

Todd Lipcon (JIRA)
Jun 23, 2011 at 11:09 pm
Jul 14, 2011 at 7:26 pm

1	[jira] [Created] (HDFS-2101) 1073: update remaining unit tests to new storage filenames

1073: update remaining unit tests to new storage filenames ---------------------------------------------------------- Key: HDFS-2101 URL: https://issues.apache.org/jira/browse/HDFS-2101 Project: ...

Todd Lipcon (JIRA)
Jun 21, 2011 at 10:52 pm
Jul 14, 2011 at 7:12 pm

1	[jira] [Created] (HDFS-2113) Use "dfsadmin -setQuota <N> <directory>...<directory>" without faults reported

Use "dfsadmin -setQuota <N <directory ...<directory " without faults reported -------------------------------------------------------------------------------- Key: HDFS-2113 URL: ...

严金双 (JIRA)
Jun 29, 2011 at 3:33 am
Jun 29, 2011 at 7:50 am

1	[jira] [Created] (HDFS-2093) 1073: Handle case where an entirely empty log is left during NN crash

1073: Handle case where an entirely empty log is left during NN crash --------------------------------------------------------------------- Key: HDFS-2093 URL: ...

Todd Lipcon (JIRA)
Jun 21, 2011 at 5:02 am
Jun 24, 2011 at 11:35 pm

1	[jira] [Created] (HDFS-2088) Move edits log archiving logic into FSEditLog/JournalManager

Move edits log archiving logic into FSEditLog/JournalManager ------------------------------------------------------------ Key: HDFS-2088 URL: https://issues.apache.org/jira/browse/HDFS-2088 Project: ...

Todd Lipcon (JIRA)
Jun 20, 2011 at 10:47 pm
Jun 24, 2011 at 10:46 pm

1	[jira] [Created] (HDFS-2078) 1073: NN should not clear storage directory when restoring removed storage

1073: NN should not clear storage directory when restoring removed storage -------------------------------------------------------------------------- Key: HDFS-2078 URL: ...

Todd Lipcon (JIRA)
Jun 16, 2011 at 11:28 pm
Jun 24, 2011 at 10:00 pm

1	[jira] [Created] (HDFS-2077) 1073: address checkpoint upload when one of the storage dirs is failed

1073: address checkpoint upload when one of the storage dirs is failed ---------------------------------------------------------------------- Key: HDFS-2077 URL: ...

Todd Lipcon (JIRA)
Jun 16, 2011 at 9:57 pm
Jun 24, 2011 at 9:48 pm

1	[jira] [Created] (HDFS-2026) 1073: 2NN needs to handle case of reformatted NN better

1073: 2NN needs to handle case of reformatted NN better ------------------------------------------------------- Key: HDFS-2026 URL: https://issues.apache.org/jira/browse/HDFS-2026 Project: Hadoop ...

Todd Lipcon (JIRA)
Jun 2, 2011 at 10:48 pm
Jun 23, 2011 at 11:13 pm

1	[jira] [Created] (HDFS-2103) Read lock must be released before acquiring a write lock

Read lock must be released before acquiring a write lock -------------------------------------------------------- Key: HDFS-2103 URL: https://issues.apache.org/jira/browse/HDFS-2103 Project: Hadoop ...

Bharath Mundlapudi (JIRA)
Jun 23, 2011 at 9:11 am
Jun 23, 2011 at 9:13 am

1	[jira] [Created] (HDFS-2085) 1073: finalize inprogress edit logs at startup

1073: finalize inprogress edit logs at startup ---------------------------------------------- Key: HDFS-2085 URL: https://issues.apache.org/jira/browse/HDFS-2085 Project: Hadoop HDFS Issue Type: ...

Todd Lipcon (JIRA)
Jun 20, 2011 at 6:23 pm
Jun 21, 2011 at 8:16 pm

1	[jira] [Created] (HDFS-2074) 1073: determine edit log validity by truly reading and validating transactions

1073: determine edit log validity by truly reading and validating transactions ------------------------------------------------------------------------------ Key: HDFS-2074 URL: ...

Todd Lipcon (JIRA)
Jun 15, 2011 at 12:59 am
Jun 21, 2011 at 4:48 pm

1	[jira] [Created] (HDFS-2091) Hadoop does not scale as expected

Hadoop does not scale as expected --------------------------------- Key: HDFS-2091 URL: https://issues.apache.org/jira/browse/HDFS-2091 Project: Hadoop HDFS Issue Type: Bug Environment: Linux, 8 ...

Alberto Andreotti (JIRA)
Jun 21, 2011 at 4:06 am
Jun 21, 2011 at 4:24 am

1	Hadoop-Hdfs-trunk - Build # 700 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/700/ ################################################################################### ########################## LAST 60 LINES OF THE CONSOLE ...

Apache Jenkins Server
Jun 19, 2011 at 12:43 pm
Jun 20, 2011 at 12:53 pm

1	[jira] [Created] (HDFS-2081) trying to read configuration in hdfs write path might result in deadlock

trying to read configuration in hdfs write path might result in deadlock ------------------------------------------------------------------------ Key: HDFS-2081 URL: ...

John George (JIRA)
Jun 17, 2011 at 10:55 pm
Jun 19, 2011 at 3:59 am

1	Possible Dataloss

Hi, In the BackupStorage.convergeJournalSpool when the jsState is in INPROGRESS we are loading edits.new file once. Later inorder to load intermediate edits we are loading edits.new file once again ...

Sravan korumilli
Jun 17, 2011 at 8:18 am
Jun 17, 2011 at 7:09 pm

1	[jira] [Created] (HDFS-2073) Namenode is missing @Override annotations

Namenode is missing @Override annotations ----------------------------------------- Key: HDFS-2073 URL: https://issues.apache.org/jira/browse/HDFS-2073 Project: Hadoop HDFS Issue Type: Improvement ...

Suresh Srinivas (JIRA)
Jun 14, 2011 at 11:15 pm
Jun 15, 2011 at 10:43 pm

1	FileSystem.close() using Threads !!!

Hi, I have 2 threads that copy file from hdfs and delete the directory after copying the file. In both the threads I use "FileSystem hdfs = FileSystem.get(conf);" Once i finish copying and deleting I ...

Karthik tunga
Jun 15, 2011 at 3:08 pm
Jun 15, 2011 at 3:36 pm

1	[jira] [Created] (HDFS-2072) Remove StringUtils.stringifyException(ie) in logger functions

Remove StringUtils.stringifyException(ie) in logger functions ------------------------------------------------------------- Key: HDFS-2072 URL: https://issues.apache.org/jira/browse/HDFS-2072 ...

Bharath Mundlapudi (JIRA)
Jun 13, 2011 at 5:23 pm
Jun 14, 2011 at 9:27 pm

1	Hadoop-Hdfs-22-branch - Build # 64 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-22-branch/64/ ################################################################################### ########################## LAST 60 LINES OF THE CONSOLE ...

Apache Jenkins Server
Jun 8, 2011 at 12:09 am
Jun 10, 2011 at 11:48 pm

1	[jira] [Created] (HDFS-2059) FsShell should support symbol links

FsShell should support symbol links ----------------------------------- Key: HDFS-2059 URL: https://issues.apache.org/jira/browse/HDFS-2059 Project: Hadoop HDFS Issue Type: New Feature Components: ...

Bochun Bai (JIRA)
Jun 10, 2011 at 11:30 am
Jun 10, 2011 at 5:18 pm

1	Hadoop-Hdfs-trunk-Commit - Build # 729 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/729/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Jenkins Server
Jun 10, 2011 at 12:33 am
Jun 10, 2011 at 2:04 am

1	[jira] [Created] (HDFS-2057) Wait time to terminate the threads causing unit tests to take longer time

Wait time to terminate the threads causing unit tests to take longer time ------------------------------------------------------------------------- Key: HDFS-2057 URL: ...

Bharath Mundlapudi (JIRA)
Jun 10, 2011 at 12:10 am
Jun 10, 2011 at 12:48 am

1	Hadoop-Hdfs-trunk-Commit - Build # 727 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/727/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Jenkins Server
Jun 9, 2011 at 6:53 pm
Jun 9, 2011 at 11:13 pm

1	[jira] [Created] (HDFS-2027) 1073: Image inspector should return finalized logs before unfinalized logs

1073: Image inspector should return finalized logs before unfinalized logs -------------------------------------------------------------------------- Key: HDFS-2027 URL: ...

Todd Lipcon (JIRA)
Jun 3, 2011 at 12:15 am
Jun 9, 2011 at 10:59 pm

1	[jira] [Created] (HDFS-2048) 1073: Improve upgrade tests from 0.22

1073: Improve upgrade tests from 0.22 ------------------------------------- Key: HDFS-2048 URL: https://issues.apache.org/jira/browse/HDFS-2048 Project: Hadoop HDFS Issue Type: Sub-task Reporter: ...

Todd Lipcon (JIRA)
Jun 7, 2011 at 11:45 pm
Jun 9, 2011 at 10:57 pm

1	[jira] [Created] (HDFS-2047) Improve TestNamespace and TestEditLog in 1073 branch

Improve TestNamespace and TestEditLog in 1073 branch ---------------------------------------------------- Key: HDFS-2047 URL: https://issues.apache.org/jira/browse/HDFS-2047 Project: Hadoop HDFS ...

Todd Lipcon (JIRA)
Jun 7, 2011 at 10:33 pm
Jun 9, 2011 at 10:52 pm

group	hdfs-dev @
categories	hadoop
discussions	146
posts	263
users	31
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > hdfs-dev > June 2011

Search Discussions

146 discussions - 263 posts

31 users for June 2011

Content

People

Support

Translate