common-dev@hadoop.apache.org discussions for September 2009

7	last map task taking too long

Hey.. I am trying to write a small mapreduce program. I launch a few map tasks, each of which should complete within a certain time (say 5 minutes)... all the tasks complete within 5 minutes except ...

Achilles852
Sep 30, 2009 at 12:58 am
Oct 1, 2009 at 12:24 am

5	[jira] Created: (HADOOP-6255) Create an rpm target in the build.xml

Create an rpm target in the build.xml ------------------------------------- Key: HADOOP-6255 URL: https://issues.apache.org/jira/browse/HADOOP-6255 Project: Hadoop Common Issue Type: New Feature ...

Owen O'Malley (JIRA)
Sep 11, 2009 at 11:22 pm
Sep 15, 2009 at 3:04 pm

3	Private, LimitedPrivate and contrib modules

I'm trying to better understand the meaning of the annotations defined in org.apache.hadoop.classification.InterfaceAudience. 1. Private is documented as being "Intended for use only within Hadoop ...

Tom White
Sep 18, 2009 at 8:29 pm
Nov 5, 2009 at 8:58 pm

3	Changes to HDFS configuration keys for 21 release

Hi, The changes to configuration keys in HDFS for 21 release are scheduled to be checked in along with the append changes. This change was delayed because configuration changes are too many and ...

Jitendra Nath Pandey
Sep 26, 2009 at 12:32 am
Sep 28, 2009 at 8:52 pm

2	Where are temp files stored?

Hi. I am wondering where the temp files (intermediate files) are stored. They should be located in the hadoop.tmp.dir by default, right? why I cannot find them in either the local file system and ...

Starry SHI
Sep 26, 2009 at 6:35 am
Sep 27, 2009 at 2:18 am

2	[jira] Created: (HADOOP-6281) HtmlQuoting throws NullPointerException

HtmlQuoting throws NullPointerException --------------------------------------- Key: HADOOP-6281 URL: https://issues.apache.org/jira/browse/HADOOP-6281 Project: Hadoop Common Issue Type: Bug ...

Tsz Wo (Nicholas), SZE (JIRA)
Sep 23, 2009 at 5:41 pm
Sep 25, 2009 at 5:50 pm

2	[jira] Created: (HADOOP-6267) build-contrib.xml unnecessarily enforces that contrib projects be located in contrib/ dir

build-contrib.xml unnecessarily enforces that contrib projects be located in contrib/ dir ----------------------------------------------------------------------------------------- Key: HADOOP-6267 ...

Todd Lipcon (JIRA)
Sep 17, 2009 at 10:46 pm
Sep 18, 2009 at 7:23 pm

2	[jira] Created: (HADOOP-6240) Rename operation is not consistent betwee different implementations of FileSystem

Rename operation is not consistent betwee different implementations of FileSystem --------------------------------------------------------------------------------- Key: HADOOP-6240 URL: ...

Suresh Srinivas (JIRA)
Sep 4, 2009 at 6:44 pm
Sep 11, 2009 at 5:31 pm

2	how to apply patch to hadoop

Hi all. I am new to hadoop and I would like to ask how to apply patches to hadoop? Is applying patches the same as "diff" and "patch" in Linux? If not, could somebody tell me how to apply the patches ...

Starry SHI
Sep 4, 2009 at 2:11 am
Sep 9, 2009 at 3:06 am

2	[jira] Created: (HADOOP-6243) NPE in handling deprecated configuration keys.

NPE in handling deprecated configuration keys. ---------------------------------------------- Key: HADOOP-6243 URL: https://issues.apache.org/jira/browse/HADOOP-6243 Project: Hadoop Common Issue ...

Konstantin Shvachko (JIRA)
Sep 7, 2009 at 7:29 pm
Sep 8, 2009 at 4:16 pm

2	[jira] Created: (HADOOP-6226) Create a LimitedByteArrayOutputStream that does not expand its buffer on write

Create a LimitedByteArrayOutputStream that does not expand its buffer on write ------------------------------------------------------------------------------ Key: HADOOP-6226 URL: ...

Jothi Padmanabhan (JIRA)
Sep 1, 2009 at 9:34 am
Sep 2, 2009 at 4:45 am

1	TestDU failures on common RedHat distributions

All, I was trying to get Hadoop compiling and passing unit tests. I have having problems with the TestDU test. I have searched the issue tracker and the web. I haven't seen much googling around for ...

Kirby Bohling
Sep 8, 2009 at 11:51 pm
Nov 19, 2010 at 3:27 am

1	[jira] Created: (HADOOP-6289) Add interface classification stable & scope to common

Add interface classification stable & scope to common ----------------------------------------------------- Key: HADOOP-6289 URL: https://issues.apache.org/jira/browse/HADOOP-6289 Project: Hadoop ...

Suresh Srinivas (JIRA)
Sep 28, 2009 at 8:41 pm
Apr 29, 2010 at 10:18 pm

1	[jira] Created: (HADOOP-6248) Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework

Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework --------------------------------------------------------------------------- Key: HADOOP-6248 URL: ...

Alex Loddengaard (JIRA)
Sep 9, 2009 at 10:20 pm
Oct 23, 2009 at 12:12 am

1	[jira] Created: (HADOOP-6292) Native Libraries Guide - Update

Native Libraries Guide - Update -------------------------------- Key: HADOOP-6292 URL: https://issues.apache.org/jira/browse/HADOOP-6292 Project: Hadoop Common Issue Type: Task Components: ...

Corinne Chandel (JIRA)
Sep 30, 2009 at 8:14 pm
Oct 21, 2009 at 12:34 am

1	Developing Hadoop and HDFS

Hello, Yes, another person looking to contribute to and develop Hadoop. I'm looking to start off small, fixing a few bugs before moving into larger stuff. First, a bit of background: Years ago I had ...

Geoffrey Gallaway
Sep 30, 2009 at 12:40 am
Sep 30, 2009 at 12:46 am

1	[jira] Created: (HADOOP-6284) Any hadoop commands crashing jvm (SIGBUS) when /tmp (tmpfs) is full

Any hadoop commands crashing jvm (SIGBUS) when /tmp (tmpfs) is full -------------------------------------------------------------------- Key: HADOOP-6284 URL: ...

Koji Noguchi (JIRA)
Sep 23, 2009 at 10:05 pm
Sep 29, 2009 at 9:29 pm

1	[jira] Created: (HADOOP-6277) Allow Sub-projects to extend and introduce new TestCLI types and tags.

Allow Sub-projects to extend and introduce new TestCLI types and tags. ---------------------------------------------------------------------- Key: HADOOP-6277 URL: ...

Sreekanth Ramakrishnan (JIRA)
Sep 22, 2009 at 9:09 am
Sep 22, 2009 at 4:44 pm

1	[jira] Created: (HADOOP-6274) TestLocalFSFileContextMainOperations tests wrongly expect a certain order to be returned.

TestLocalFSFileContextMainOperations tests wrongly expect a certain order to be returned. ----------------------------------------------------------------------------------------- Key: HADOOP-6274 ...

gary murry (JIRA)
Sep 21, 2009 at 5:31 pm
Sep 22, 2009 at 4:18 am

1	[jira] Created: (HADOOP-6259) Fair Scheduler in core.jar

Fair Scheduler in core.jar -------------------------- Key: HADOOP-6259 URL: https://issues.apache.org/jira/browse/HADOOP-6259 Project: Hadoop Common Issue Type: Wish Affects Versions: 0.20.1 ...

Anjali M (JIRA)
Sep 16, 2009 at 6:24 am
Sep 16, 2009 at 6:40 am

1	[jira] Created: (HADOOP-6231) Allow caching of filesystem instances to be disabled on a per-instance basis

Allow caching of filesystem instances to be disabled on a per-instance basis ---------------------------------------------------------------------------- Key: HADOOP-6231 URL: ...

Tom White (JIRA)
Sep 2, 2009 at 6:52 am
Sep 15, 2009 at 2:50 pm

1	[jira] Created: (HADOOP-6250) test-patch.sh doesn't clean up conf/*.xml files after the trunk run.

test-patch.sh doesn't clean up conf/*.xml files after the trunk run. -------------------------------------------------------------------- Key: HADOOP-6250 URL: ...

rahul k singh (JIRA)
Sep 10, 2009 at 9:30 am
Sep 15, 2009 at 1:19 pm

1	[jira] Created: (HADOOP-6230) Move process tree, and memory calculator classes out of Common into Map/Reduce.

Move process tree, and memory calculator classes out of Common into Map/Reduce. ------------------------------------------------------------------------------- Key: HADOOP-6230 URL: ...

Vinod K V (JIRA)
Sep 2, 2009 at 5:25 am
Sep 7, 2009 at 3:57 pm

0	[jira] Created: (HADOOP-6293) FsShell -text should work on filesystems other than the default

FsShell -text should work on filesystems other than the default --------------------------------------------------------------- Key: HADOOP-6293 URL: https://issues.apache.org/jira/browse/HADOOP-6293 ...

Chris Douglas (JIRA)
Sep 30, 2009 at 10:39 pm
Sep 30, 2009 at 10:39 pm

0	[jira] Resolved: (HADOOP-3197) Deadlock in DFCClient

[ https://issues.apache.org/jira/browse/HADOOP-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HADOOP-3197. -------------------------------------- ...

dhruba borthakur (JIRA)
Sep 30, 2009 at 7:16 am
Sep 30, 2009 at 7:16 am

0	[jira] Created: (HADOOP-6291) Confusing warn message from Configuration

Confusing warn message from Configuration ----------------------------------------- Key: HADOOP-6291 URL: https://issues.apache.org/jira/browse/HADOOP-6291 Project: Hadoop Common Issue Type: Bug ...

Tsz Wo (Nicholas), SZE (JIRA)
Sep 29, 2009 at 10:38 pm
Sep 29, 2009 at 10:38 pm

0	[jira] Created: (HADOOP-6290) AutoInputFormat + (larger) bzip2 files cause multiple runs over same file

AutoInputFormat + (larger) bzip2 files cause multiple runs over same file ------------------------------------------------------------------------- Key: HADOOP-6290 URL: ...

Erik Forsberg (JIRA)
Sep 29, 2009 at 9:12 am
Sep 29, 2009 at 9:12 am

0	[jira] Resolved: (HADOOP-4492) Job-specific data on HDFS (job.xml, input splits etc.) should have right access-control

[ https://issues.apache.org/jira/browse/HADOOP-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-4492. ----------------------------------- ...

Owen O'Malley (JIRA)
Sep 28, 2009 at 11:19 pm
Sep 28, 2009 at 11:19 pm

0	Bloksmap.map<Block, BlockInfo>

Hi, I've been puzzling . hadoop-0.17.1\src\java\org\apache\hadoop\dfs\Blocksmap.java line 291 private Map<Block, BlockInfo map = new HashMap<Block, BlockInfo (); why is not -- private Map<BlockInfo, ...

Springring
Sep 27, 2009 at 3:20 pm
Sep 27, 2009 at 3:20 pm

0	[jira] Created: (HADOOP-6288) Improve Configuration to support default and minimum values

Improve Configuration to support default and minimum values ------------------------------------------------------------ Key: HADOOP-6288 URL: https://issues.apache.org/jira/browse/HADOOP-6288 ...

Arun C Murthy (JIRA)
Sep 27, 2009 at 5:01 am
Sep 27, 2009 at 5:01 am

0	[jira] Created: (HADOOP-6287) Support units for configuration knobs

Support units for configuration knobs ------------------------------------- Key: HADOOP-6287 URL: https://issues.apache.org/jira/browse/HADOOP-6287 Project: Hadoop Common Issue Type: Improvement ...

Arun C Murthy (JIRA)
Sep 27, 2009 at 4:37 am
Sep 27, 2009 at 4:37 am

0	[jira] Resolved: (HADOOP-4013) SocketException with S3 native file system causes job to fail

[ https://issues.apache.org/jira/browse/HADOOP-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White resolved HADOOP-4013. ------------------------------- Resolution: ...

Tom White (JIRA)
Sep 25, 2009 at 4:10 pm
Sep 25, 2009 at 4:10 pm

0	[jira] Created: (HADOOP-6286) The Glob methods in FileContext doe not deal with URIs correctly

The Glob methods in FileContext doe not deal with URIs correctly ---------------------------------------------------------------- Key: HADOOP-6286 URL: ...

Sanjay Radia (JIRA)
Sep 24, 2009 at 11:38 pm
Sep 24, 2009 at 11:38 pm

0	[jira] Created: (HADOOP-6285) HttpServer.QuotingInputFilter has the wrong signature for getParameterMap

HttpServer.QuotingInputFilter has the wrong signature for getParameterMap ------------------------------------------------------------------------- Key: HADOOP-6285 URL: ...

Owen O'Malley (JIRA)
Sep 24, 2009 at 11:00 pm
Sep 24, 2009 at 11:00 pm

0	How to recover the state from the previous checkpoint in HDFS when the custer is DOWN and the edits file was broken.

Hi, NN was unable to process any request since it's cast more exceptions. and then the NN can't be started, because fseditlog reads a unknown opcode when NN is loading edits file. Now, the ...

Yajun.don
Sep 24, 2009 at 4:40 pm
Sep 24, 2009 at 4:40 pm

0	Streaming preserving text order

Hi, I developed a simple "custom streaming" that permits to perform a mappers-only text processing without shuffling result due to key sorting. We successfully use it for semantical precessing on ...

Francesco Tamberi
Sep 24, 2009 at 9:34 am
Sep 24, 2009 at 9:34 am

0	[jira] Created: (HADOOP-6283) FileUtil$HardLink.getLinkCount(..) throws NumberFormatException

FileUtil$HardLink.getLinkCount(..) throws NumberFormatException --------------------------------------------------------------- Key: HADOOP-6283 URL: https://issues.apache.org/jira/browse/HADOOP-6283 ...

Tsz Wo (Nicholas), SZE (JIRA)
Sep 23, 2009 at 9:57 pm
Sep 23, 2009 at 9:57 pm

0	[jira] Created: (HADOOP-6282) test-patch should verify that FindBugs version used for verification is correct one

test-patch should verify that FindBugs version used for verification is correct one ----------------------------------------------------------------------------------- Key: HADOOP-6282 URL: ...

Konstantin Boudnik (JIRA)
Sep 23, 2009 at 6:37 pm
Sep 23, 2009 at 6:37 pm

0	[jira] Created: (HADOOP-6280) Uniform way of setting default param for ToolRunner (like passing -Ddfs.umask)

Uniform way of setting default param for ToolRunner (like passing -Ddfs.umask) ------------------------------------------------------------------------------ Key: HADOOP-6280 URL: ...

Koji Noguchi (JIRA)
Sep 23, 2009 at 4:50 pm
Sep 23, 2009 at 4:50 pm

0	[jira] Resolved: (HADOOP-4991) Reduce task getting map output over HTTP should have right access control

[ https://issues.apache.org/jira/browse/HADOOP-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-4991. ----------------------------------- ...

Owen O'Malley (JIRA)
Sep 22, 2009 at 11:09 pm
Sep 22, 2009 at 11:09 pm

0	[jira] Created: (HADOOP-6279) Add JVM memory usage to JvmMetrics

Add JVM memory usage to JvmMetrics ---------------------------------- Key: HADOOP-6279 URL: https://issues.apache.org/jira/browse/HADOOP-6279 Project: Hadoop Common Issue Type: Improvement Affects ...

Todd Lipcon (JIRA)
Sep 22, 2009 at 11:03 pm
Sep 22, 2009 at 11:03 pm

0	[jira] Created: (HADOOP-6278) Update HowToCommit with clear list of Committer responsibilities

Update HowToCommit with clear list of Committer responsibilities ---------------------------------------------------------------- Key: HADOOP-6278 URL: ...

Nigel Daley (JIRA)
Sep 22, 2009 at 10:32 pm
Sep 22, 2009 at 10:32 pm

0	[jira] Created: (HADOOP-6276) test-patch script should -1 patches that increase the number of Thread.sleep() calls in tests

test-patch script should -1 patches that increase the number of Thread.sleep() calls in tests --------------------------------------------------------------------------------------------- Key: ...

Nigel Daley (JIRA)
Sep 22, 2009 at 4:56 am
Sep 22, 2009 at 4:56 am

0	[jira] Created: (HADOOP-6275) All the FileSystem tests should be cleaned up

All the FileSystem tests should be cleaned up --------------------------------------------- Key: HADOOP-6275 URL: https://issues.apache.org/jira/browse/HADOOP-6275 Project: Hadoop Common Issue Type: ...

gary murry (JIRA)
Sep 21, 2009 at 7:31 pm
Sep 21, 2009 at 7:31 pm

0	Hadoop Common, HDFS, and Map/Reduce 0.21 branched

All, I have branched Common, HDFS, and Map/Reduce 0.21. From now on, you either need a vote to commit or it needs to be a critical bug. If you have a question, please ask. Have a great weekend! Next ...

Owen O'Malley
Sep 19, 2009 at 1:33 am
Sep 19, 2009 at 1:33 am

0	[jira] Created: (HADOOP-6273) Create and Mkdir recursive flag should be passed to HDFS for HDFS filesystem

Create and Mkdir recursive flag should be passed to HDFS for HDFS filesystem ---------------------------------------------------------------------------- Key: HADOOP-6273 URL: ...

Sanjay Radia (JIRA)
Sep 18, 2009 at 11:46 pm
Sep 18, 2009 at 11:46 pm

0	[jira] Created: (HADOOP-6271) Fix FileContext to allow both recursive and non recursive create and mkdir

Fix FileContext to allow both recursive and non recursive create and mkdir -------------------------------------------------------------------------- Key: HADOOP-6271 URL: ...

Sanjay Radia (JIRA)
Sep 18, 2009 at 3:13 pm
Sep 18, 2009 at 3:13 pm

0	[jira] Resolved: (HADOOP-5992) Add ivy/ivy*.jar to .gitignore

[ https://issues.apache.org/jira/browse/HADOOP-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved HADOOP-5992. ----------------------------------- ...

Chris Douglas (JIRA)
Sep 18, 2009 at 9:49 am
Sep 18, 2009 at 9:49 am

0	[jira] Resolved: (HADOOP-5560) Build generates unchecked cast warnings from o.a.h.mapred.Task

[ https://issues.apache.org/jira/browse/HADOOP-5560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-5560. ----------------------------------- ...

Owen O'Malley (JIRA)
Sep 18, 2009 at 5:28 am
Sep 18, 2009 at 5:28 am

0	[jira] Created: (HADOOP-6270) FileContext needs to provide deleteOnExit functionality

FileContext needs to provide deleteOnExit functionality ------------------------------------------------------- Key: HADOOP-6270 URL: https://issues.apache.org/jira/browse/HADOOP-6270 Project: Hadoop ...

Suresh Srinivas (JIRA)
Sep 18, 2009 at 3:46 am
Sep 18, 2009 at 3:46 am

group	common-dev @
categories	hadoop
discussions	90
posts	167
users	41
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > common-dev > September 2009

Search Discussions

90 discussions - 167 posts

41 users for September 2009

Content

People

Support

Translate