common-dev@hadoop.apache.org discussions for October 2010

9	Hadoop's deafult FIFO scheduler

Hi all I am testing the performance of my Hadoop clsuters with Hadoop Default FIFO schedular. But I find a interesting phenomina. When I submit a series of jobs, some job will be executed earlier ...

He Chen
Oct 14, 2010 at 5:06 pm
Oct 23, 2010 at 1:05 pm

7	mapper and reducer scheduling

Hi, all I wonder how Hadoop schedules mappers and reducers (e.g. consider load balancing, affinity to data?). For example, how to decide on which nodes mappers and reducers are to be executed and ...

Zhenhua Guo
Oct 28, 2010 at 9:53 pm
Nov 3, 2010 at 9:41 pm

6	Multi-Master Hadoop Configuration

Hi All, I've searched for a while on the possibility to configure multiple masters to govern large number of slaves, but I barely found any except for multi-masters for backup in HBase. Is one master ...

Wang, Chengwei
Oct 27, 2010 at 9:56 pm
Oct 29, 2010 at 1:07 pm

4	About MapReduce's Setup

Hi, all I found out that if the there is no map slot, Hadoop will use reduce slot to setup mapreduce job when I submit a series of jobs. The first two jobs setuped themselves with a MapAttempt. ...

He Chen
Oct 13, 2010 at 8:25 pm
Oct 23, 2010 at 1:06 pm

4	what happens inside hadoop !!

Hi ALL, Is there any documentation or guide or any presentation about what happens inside hadoop. I mean, there are different documentation about map-reduce and hdfs and they tell what the do, but ...

Ahmad Shahzad
Oct 22, 2010 at 2:32 pm
Oct 23, 2010 at 9:53 am

3	[DISCUSSION]: Future of Hadoop system testing

All, I want to start a discussion about future approaches to perform Hadoop system (and potentially other types of) testing in 0.22 and later. As many of you know recent development effort from a ...

Konstantin Boudnik
Oct 8, 2010 at 9:06 pm
Oct 14, 2010 at 7:55 pm

2	Mumak is still active?

Hi, all I'm working with Mumak recently, but I found that the code hasn't been updated for a long while, I would like to know that if the Mumak is still active? Thank you Nan

Nan Zhu
Oct 28, 2010 at 6:53 am
Oct 29, 2010 at 2:04 am

2	Combiner and MultipleOutputs in Mapreduce

Hi, most of the example code I read has the following configuration (using the same Reduce class as the Combiner and the Reducer) conf.setCombinerClass(Reduce.class); ...

ShiYu
Oct 6, 2010 at 4:44 am
Oct 6, 2010 at 4:55 am

1	[jira] Created: (HADOOP-7013) Add boolean field isCorrupt to BlockLocation

Add boolean field isCorrupt to BlockLocation -------------------------------------------- Key: HADOOP-7013 URL: https://issues.apache.org/jira/browse/HADOOP-7013 Project: Hadoop Common Issue Type: ...

Patrick Kling (JIRA)
Oct 28, 2010 at 11:11 pm
Nov 17, 2010 at 5:32 am

1	[jira] Created: (HADOOP-7008) Enable test-patch.sh to have a configured number of acceptable findbugs and javadoc warnings

Enable test-patch.sh to have a configured number of acceptable findbugs and javadoc warnings -------------------------------------------------------------------------------------------- Key: ...

Nigel Daley (JIRA)
Oct 26, 2010 at 1:38 am
Nov 2, 2010 at 5:37 am

1	Build failed in Hudson: Hadoop-Common-trunk-Commit #408

See <https://hudson.apache.org/hudson/job/Hadoop-Common-trunk-Commit/408/changes Changes: [cutting] HADOOP-7011. Fix KerberosName.main() to not throw an NPE. Contributed by Aaron T. Myers. ...

Apache Hudson Server
Oct 29, 2010 at 11:18 pm
Nov 1, 2010 at 10:47 pm

1	[jira] Created: (HADOOP-6990) Move TestSequenceFile from MapReduce to Common

Move TestSequenceFile from MapReduce to Common ---------------------------------------------- Key: HADOOP-6990 URL: https://issues.apache.org/jira/browse/HADOOP-6990 Project: Hadoop Common Issue ...

Chris Douglas (JIRA)
Oct 5, 2010 at 2:26 am
Oct 29, 2010 at 9:08 pm

1	Build failed in Hudson: Hadoop-Common-trunk-Commit #406

See <https://hudson.apache.org/hudson/job/Hadoop-Common-trunk-Commit/406/changes Changes: [omalley] HADOOP-6991. Move testcase from mapreduce to common, since it tests SequenceFile. ...

Apache Hudson Server
Oct 28, 2010 at 7:35 pm
Oct 28, 2010 at 9:20 pm

1	[jira] Created: (HADOOP-7009) MD5Hash provides a public factory method that creates an instance of MessageDigest

MD5Hash provides a public factory method that creates an instance of MessageDigest ---------------------------------------------------------------------------------- Key: HADOOP-7009 URL: ...

Hairong Kuang (JIRA)
Oct 26, 2010 at 9:27 pm
Oct 28, 2010 at 6:52 pm

1	[jira] Created: (HADOOP-7007) update the hudson-test-patch target to work with the latest test-patch script.

update the hudson-test-patch target to work with the latest test-patch script. ------------------------------------------------------------------------------ Key: HADOOP-7007 URL: ...

Giridharan Kesavan (JIRA)
Oct 25, 2010 at 9:30 pm
Oct 25, 2010 at 11:10 pm

1	[jira] Created: (HADOOP-6985) Suggest that HADOOP_OPTS be preserved in hadoop-env.sh.template

Suggest that HADOOP_OPTS be preserved in hadoop-env.sh.template --------------------------------------------------------------- Key: HADOOP-6985 URL: https://issues.apache.org/jira/browse/HADOOP-6985 ...

Ramkumar Vadali (JIRA)
Oct 4, 2010 at 8:39 pm
Oct 25, 2010 at 11:04 pm

1	[jira] Created: (HADOOP-7005) Update test-patch.sh to remove callback to Hudson master

Update test-patch.sh to remove callback to Hudson master -------------------------------------------------------- Key: HADOOP-7005 URL: https://issues.apache.org/jira/browse/HADOOP-7005 Project: ...

Nigel Daley (JIRA)
Oct 25, 2010 at 6:33 am
Oct 25, 2010 at 7:02 pm

1	i want to contribute

i've been looking into contributing the code base and figured writing test cases for the common mapreduce examples was a good place to start. i got this idea ofcourse, from the main project ...

Goutham patnaik
Oct 25, 2010 at 6:08 am
Oct 25, 2010 at 6:16 am

1	Build failed in Hudson: Hadoop-Common-trunk #488

See <https://hudson.apache.org/hudson/job/Hadoop-Common-trunk/488/ ------------------------------------------ [...truncated 20310 lines...] [junit] checkDir success: false [junit] at ...

Apache Hudson Server
Oct 21, 2010 at 8:53 pm
Oct 22, 2010 at 12:56 pm

1	[jira] Created: (HADOOP-7003) Fix hadoop patch testing using jira_cli tool

Fix hadoop patch testing using jira_cli tool -------------------------------------------- Key: HADOOP-7003 URL: https://issues.apache.org/jira/browse/HADOOP-7003 Project: Hadoop Common Issue Type: ...

Giridharan Kesavan (JIRA)
Oct 20, 2010 at 8:54 pm
Oct 22, 2010 at 6:53 am

1	Namenode reboot - namespace

Hi, I have a small doubt regarding Hadoop. For a cluster without secondary namenode, a namenode reboots itself after failure. For a scenario,when a namenode reboots itself, and looses all the ...

Null Ecksor
Oct 14, 2010 at 7:59 pm
Oct 14, 2010 at 8:56 pm

1	[jira] Created: (HADOOP-6992) Update website for recent subproject departures

Update website for recent subproject departures ----------------------------------------------- Key: HADOOP-6992 URL: https://issues.apache.org/jira/browse/HADOOP-6992 Project: Hadoop Common Issue ...

Doug Cutting (JIRA)
Oct 6, 2010 at 11:02 pm
Oct 14, 2010 at 3:48 pm

1	[jira] Created: (HADOOP-6993) Broken link on cluster setup page of docs

Broken link on cluster setup page of docs ----------------------------------------- Key: HADOOP-6993 URL: https://issues.apache.org/jira/browse/HADOOP-6993 Project: Hadoop Common Issue Type: Task ...

Aaron T. Myers (JIRA)
Oct 7, 2010 at 4:18 am
Oct 7, 2010 at 5:55 pm

1	(HADOOP-6916) Implement append operation for S3FileSystem

Hi, guys! Can somebody please help me to get this issue fixed in some of the upcoming releases? I've attached a patch, but not sure why the automatic verification has not started. Thanks, Oleg.

Aleshko, Oleg
Oct 5, 2010 at 3:53 pm
Oct 6, 2010 at 10:41 pm

1

libjvm.so

Hi, I compiled the program uses libhdfs, which need libjvm.so, on 32-bit java environment and run the job on a 64-bit java environment. But got "error while loading shared libraries: libjvm.so: wrong ...

Jmpopush
Oct 4, 2010 at 2:48 pm
Oct 4, 2010 at 3:00 pm

0	[jira] Created: (HADOOP-7014) Generalize CLITest structure and interfaces to faciliate upstream adoption (e.g. for web testing)

Generalize CLITest structure and interfaces to faciliate upstream adoption (e.g. for web testing) ------------------------------------------------------------------------------------------------- ...

Konstantin Boudnik (JIRA)
Oct 30, 2010 at 4:12 am
Oct 30, 2010 at 4:12 am

0	[jira] Created: (HADOOP-7012) IPC.Client may have some connection for each a given host/port

IPC.Client may have some connection for each a given host/port -------------------------------------------------------------- Key: HADOOP-7012 URL: https://issues.apache.org/jira/browse/HADOOP-7012 ...

tom liu (JIRA)
Oct 28, 2010 at 9:56 am
Oct 28, 2010 at 9:56 am

0	[jira] Created: (HADOOP-7011) KerberosName.main(...) throws NPE

KerberosName.main(...) throws NPE --------------------------------- Key: HADOOP-7011 URL: https://issues.apache.org/jira/browse/HADOOP-7011 Project: Hadoop Common Issue Type: Bug Affects Versions: ...

Aaron T. Myers (JIRA)
Oct 27, 2010 at 7:45 pm
Oct 27, 2010 at 7:45 pm

0	[jira] Created: (HADOOP-7010) Typo in FileSystem.java

Typo in FileSystem.java ----------------------- Key: HADOOP-7010 URL: https://issues.apache.org/jira/browse/HADOOP-7010 Project: Hadoop Common Issue Type: Improvement Components: fs Affects Versions: ...

Jingguo Yao (JIRA)
Oct 27, 2010 at 4:40 pm
Oct 27, 2010 at 4:40 pm

0	[HADOOP-6317] Serialize the 'final'ness of Configuration keys - ASF JIRA

Arun, are you still interested in this issue? https://issues.apache.org/jira/browse/HADOOP-6317 This was the oldest item in the patch queue. I have updated the patch to apply to current trunk. It ...

Doug Cutting
Oct 26, 2010 at 12:13 am
Oct 26, 2010 at 12:13 am

0	[jira] Created: (HADOOP-7006) hadoop fs -getmerge does not work using codebase from trunk.

hadoop fs -getmerge does not work using codebase from trunk. ------------------------------------------------------------ Key: HADOOP-7006 URL: https://issues.apache.org/jira/browse/HADOOP-7006 ...

Chris Nauroth (JIRA)
Oct 25, 2010 at 6:41 am
Oct 25, 2010 at 6:41 am

0	Hudson build is back to normal : Hadoop-Common-trunk-Commit #395

See <https://hudson.apache.org/hudson/job/Hadoop-Common-trunk-Commit/395/

Apache Hudson Server
Oct 21, 2010 at 8:01 pm
Oct 21, 2010 at 8:01 pm

0	[jira] Created: (HADOOP-7004) Problem with org.apache.hadoop.conf.Configuration.REGISTRY

Problem with org.apache.hadoop.conf.Configuration.REGISTRY ---------------------------------------------------------- Key: HADOOP-7004 URL: https://issues.apache.org/jira/browse/HADOOP-7004 Project: ...

Henning Blohm (JIRA)
Oct 21, 2010 at 8:14 am
Oct 21, 2010 at 8:14 am

0	[jira] Created: (HADOOP-7002) copy

copy ---- Key: HADOOP-7002 URL: https://issues.apache.org/jira/browse/HADOOP-7002 Project: Hadoop Common Issue Type: Bug Reporter: Jingguo Yao -- This message is automatically generated by JIRA. - ...

Jingguo Yao (JIRA)
Oct 18, 2010 at 1:24 pm
Oct 18, 2010 at 1:24 pm

0	[jira] Created: (HADOOP-7001) Allow configuration changes without restarting configured nodes

Allow configuration changes without restarting configured nodes --------------------------------------------------------------- Key: HADOOP-7001 URL: https://issues.apache.org/jira/browse/HADOOP-7001 ...

Patrick Kling (JIRA)
Oct 14, 2010 at 6:38 pm
Oct 14, 2010 at 6:38 pm

0	[jira] Created: (HADOOP-7000) Options.createOpts should provide API to set Progressable

Options.createOpts should provide API to set Progressable --------------------------------------------------------- Key: HADOOP-7000 URL: https://issues.apache.org/jira/browse/HADOOP-7000 Project: ...

Krishna Ramachandran (JIRA)
Oct 13, 2010 at 12:24 am
Oct 13, 2010 at 12:24 am

0	[jira] Created: (HADOOP-6999) security implementation for new FileSystem (FileContext) API

security implementation for new FileSystem (FileContext) API ------------------------------------------------------------ Key: HADOOP-6999 URL: https://issues.apache.org/jira/browse/HADOOP-6999 ...

Krishna Ramachandran (JIRA)
Oct 12, 2010 at 5:53 pm
Oct 12, 2010 at 5:53 pm

0	[jira] Created: (HADOOP-6998) Add alternative search-provider to site

Add alternative search-provider to site --------------------------------------- Key: HADOOP-6998 URL: https://issues.apache.org/jira/browse/HADOOP-6998 Project: Hadoop Common Issue Type: Improvement ...

Alex Baranau (JIRA)
Oct 12, 2010 at 12:19 pm
Oct 12, 2010 at 12:19 pm

0	[jira] Created: (HADOOP-6997) 'hadoop' script should set LANG or LC_COLLATE explicitly for classpath order

'hadoop' script should set LANG or LC_COLLATE explicitly for classpath order ---------------------------------------------------------------------------- Key: HADOOP-6997 URL: ...

Greg Roelofs (JIRA)
Oct 12, 2010 at 4:30 am
Oct 12, 2010 at 4:30 am

0	[jira] Created: (HADOOP-6996) Allow CodecFactory to return a codec object given a codec' class name

Allow CodecFactory to return a codec object given a codec' class name --------------------------------------------------------------------- Key: HADOOP-6996 URL: ...

Hairong Kuang (JIRA)
Oct 11, 2010 at 6:31 pm
Oct 11, 2010 at 6:31 pm

0	Mumak's Speculative Execution

Hi, all I'm a student in University of Nebraska, Lincoln, I'm interested in the project of mumak and I truly need a simulator of hadoop for my work I read the source code of hadoop-mapred as well as ...

Nan Zhu
Oct 11, 2010 at 4:18 pm
Oct 11, 2010 at 4:18 pm

0	FileUtil.copyMerge()

Hi guys, [Not very sure if this is the right place for this] This is regarding the issue https://issues.apache.org/jira/browse/HADOOP-2120 common/src/java/org/apache/hadoop/fs/FileUtil.java has a bug ...

Karthik Kambatla
Oct 11, 2010 at 5:25 am
Oct 11, 2010 at 5:25 am

0	Where is the log files when I use mumak

Hi, all I'm studying the implementation of mumak , My question is that the log file generated by mumak only contains the result of the logging statement in mumak source codes, but the information ...

Nan Zhu
Oct 10, 2010 at 3:51 pm
Oct 10, 2010 at 3:51 pm

0	[jira] Created: (HADOOP-6995) Allow wildcards to be used in ProxyUsers configurations

Allow wildcards to be used in ProxyUsers configurations ------------------------------------------------------- Key: HADOOP-6995 URL: https://issues.apache.org/jira/browse/HADOOP-6995 Project: Hadoop ...

Todd Lipcon (JIRA)
Oct 8, 2010 at 6:11 am
Oct 8, 2010 at 6:11 am

0	[jira] Created: (HADOOP-6994) Api in FileContext to get delegation tokens.

Api in FileContext to get delegation tokens. -------------------------------------------- Key: HADOOP-6994 URL: https://issues.apache.org/jira/browse/HADOOP-6994 Project: Hadoop Common Issue Type: ...

Jitendra Nath Pandey (JIRA)
Oct 7, 2010 at 6:25 pm
Oct 7, 2010 at 6:25 pm

0	[jira] Created: (HADOOP-6991) SequenceFile::Reader discards length for files, does not call openFile

SequenceFile::Reader discards length for files, does not call openFile ---------------------------------------------------------------------- Key: HADOOP-6991 URL: ...

Chris Douglas (JIRA)
Oct 5, 2010 at 2:28 am
Oct 5, 2010 at 2:28 am

0	[jira] Created: (HADOOP-6989) TestSetFile is failing on trunk

TestSetFile is failing on trunk ------------------------------- Key: HADOOP-6989 URL: https://issues.apache.org/jira/browse/HADOOP-6989 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.22.0 ...

Jakob Homan (JIRA)
Oct 4, 2010 at 11:56 pm
Oct 4, 2010 at 11:56 pm

0	[jira] Created: (HADOOP-6988) Add support for reading multiple hadoop delegation token files

Add support for reading multiple hadoop delegation token files -------------------------------------------------------------- Key: HADOOP-6988 URL: https://issues.apache.org/jira/browse/HADOOP-6988 ...

Aaron T. Myers (JIRA)
Oct 4, 2010 at 11:28 pm
Oct 4, 2010 at 11:28 pm

0	[jira] Created: (HADOOP-6987) Use JUnit Rule to optionally fail test cases that run more than 10 seconds

Use JUnit Rule to optionally fail test cases that run more than 10 seconds -------------------------------------------------------------------------- Key: HADOOP-6987 URL: ...

Jakob Homan (JIRA)
Oct 4, 2010 at 10:22 pm
Oct 4, 2010 at 10:22 pm

0	[jira] Created: (HADOOP-6986) SequenceFile.Reader should distinguish between Network IOE and Parsing IOE

SequenceFile.Reader should distinguish between Network IOE and Parsing IOE -------------------------------------------------------------------------- Key: HADOOP-6986 URL: ...

Nicolas Spiegelberg (JIRA)
Oct 4, 2010 at 9:37 pm
Oct 4, 2010 at 9:37 pm

group	common-dev @
categories	hadoop
discussions	51
posts	111
users	35
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > common-dev > October 2010

Search Discussions

51 discussions - 111 posts

35 users for October 2010

Content

People

Support

Translate