common-dev@hadoop.apache.org discussions for March 2010

55	[DISCUSSION] Release process

From our 21 experience, it looks like our old release strategy is failing. In looking around, I found that HTTPD's release strategy is extremely different and seems much more likely to produce usable ...

Owen O'Malley
Mar 15, 2010 at 4:08 pm
Apr 6, 2010 at 9:09 pm

9	Namespace partitioning using Locality Sensitive Hashing

Hi, I am a graduate student in Computer Science department at SUNY Stony Brook. I am thinking of doing a project on Hadoop for my course "Cloud Computing" conducted by Prof. Radu Sion. While going ...

Ketan Dixit
Mar 1, 2010 at 4:49 pm
Mar 2, 2010 at 2:04 pm

8	Hadoop Compatibility and EMR

Hi, We 've been using hadoop 15.5 in our production environment where we have about 10 TB of data stored on the dfs. The files were generated as mapreduce output. We want to move our env. to Amazon ...

Ilayaraja
Mar 21, 2010 at 6:05 pm
Apr 23, 2010 at 6:41 pm

8	Map Reduce in heterogeneous environ..

hi all map reduce is running on hadoop clusters(homogeneous).is it possible to use it in a heterogeneous environment..is that we need any interface to support this?? suggestion please. Regards Suji ...

Sujitha
Mar 11, 2010 at 7:40 am
Mar 12, 2010 at 5:09 am

4	Should the Hadoop Common artifacts be called hadoop-common-{version}[-sources\|javadoc].jar or hadoop-core-{version}[-sources\|javadoc].jar?

Hi, how should the Hadoop Common artifacts be called: - hadoop-core-{version}.jar - hadoop-core-{version}-sources.jar - hadoop-core-{version}-javadoc.jar or: - hadoop-common-{version}.jar - ...

Paolo Castagna
Mar 23, 2010 at 2:08 pm
Mar 23, 2010 at 3:47 pm

2	[jira] Created: (HADOOP-6664) fs.inmemory.size.mb not listed in conf. Cluster setup page gives wrong advice.

fs.inmemory.size.mb not listed in conf. Cluster setup page gives wrong advice. ------------------------------------------------------------------------------ Key: HADOOP-6664 URL: ...

Edward Capriolo (JIRA)
Mar 29, 2010 at 4:12 pm
Apr 19, 2010 at 4:12 pm

2	[jira] Created: (HADOOP-6662) hadoop zlib compression does not fully utilize the buffer

hadoop zlib compression does not fully utilize the buffer --------------------------------------------------------- Key: HADOOP-6662 URL: https://issues.apache.org/jira/browse/HADOOP-6662 Project: ...

Xiao Kang (JIRA)
Mar 29, 2010 at 7:59 am
Mar 30, 2010 at 6:46 am

2	adding new filesystems

I'm looking at what it currently takes to implement new back end filestores, getting lost in the details. This is my current understanding -am I wrong? 1. There is an AbstractFileSystem, came in with ...

Steve Loughran
Mar 24, 2010 at 10:29 am
Mar 24, 2010 at 5:18 pm

2	Why hadoop jobs need setup and cleanup phases which would consume a lot of time ?

Hi all, Why hadoop jobs need setup and cleanup phases which would consume a lot of time ? Why could not us archieve it like a distributed RDBMS does a master process coordinates all salve nodes ...

Min Zhou
Mar 11, 2010 at 3:05 am
Mar 13, 2010 at 8:22 am

2	Error running Hadoop Job

have compiled the program without errors. This is what my .jar file looks like: Its name is Election.jar Directory:hadoop@varun:~/ hadoop-0.20.1 Inside the jar these are the files Election.class ...

Varun Thacker
Mar 8, 2010 at 10:59 am
Mar 9, 2010 at 4:54 am

1	[jira] Created: (HADOOP-6663) BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file

BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file ------------------------------------------------------------------------------------------------ Key: ...

Xiao Kang (JIRA)
Mar 29, 2010 at 8:19 am
Oct 25, 2010 at 11:59 pm

1	[jira] Created: (HADOOP-6628) Make Cloudera commit logs and Yahoo! change logs into web-readable formats

Make Cloudera commit logs and Yahoo! change logs into web-readable formats -------------------------------------------------------------------------- Key: HADOOP-6628 URL: ...

Allen Wittenauer (JIRA)
Mar 11, 2010 at 6:45 pm
Oct 14, 2010 at 7:50 pm

1	[jira] Created: (HADOOP-6653) NullPointerException in setupSaslConnection when browsing directories

NullPointerException in setupSaslConnection when browsing directories --------------------------------------------------------------------- Key: HADOOP-6653 URL: ...

Owen O'Malley (JIRA)
Mar 21, 2010 at 9:13 pm
Jul 29, 2010 at 5:50 pm

1	[jira] Created: (HADOOP-6661) User document for UserGroupInformation.doAs

User document for UserGroupInformation.doAs ------------------------------------------- Key: HADOOP-6661 URL: https://issues.apache.org/jira/browse/HADOOP-6661 Project: Hadoop Common Issue Type: ...

Jitendra Nath Pandey (JIRA)
Mar 25, 2010 at 9:53 pm
Jun 4, 2010 at 12:42 am

1	[jira] Created: (HADOOP-6618) fs -ls does not work if a path name contains the ^ character

fs -ls does not work if a path name contains the ^ character ------------------------------------------------------------ Key: HADOOP-6618 URL: https://issues.apache.org/jira/browse/HADOOP-6618 ...

Tsz Wo (Nicholas), SZE (JIRA)
Mar 5, 2010 at 9:52 pm
Jun 3, 2010 at 1:50 am

1	Where MR meets block locations

I am interested in a few things, all pertaining to hdfs block locations for running map tasks. I have spent several days looking through the hadoop source code and have arrived at a couple of ...

Mike Cardosa
Mar 30, 2010 at 2:03 am
Mar 31, 2010 at 10:40 pm

1	[jira] Created: (HADOOP-6665) DFSadmin commands setQuota and setSpaceQuota allowed when NameNode is in safemode.

DFSadmin commands setQuota and setSpaceQuota allowed when NameNode is in safemode. ------------------------------------------------------------------------------------ Key: HADOOP-6665 URL: ...

Ravi Phulari (JIRA)
Mar 30, 2010 at 10:00 pm
Mar 31, 2010 at 6:22 am

1	[jira] Created: (HADOOP-6660) add Writable wrapper for Avro data

add Writable wrapper for Avro data ---------------------------------- Key: HADOOP-6660 URL: https://issues.apache.org/jira/browse/HADOOP-6660 Project: Hadoop Common Issue Type: New Feature ...

Doug Cutting (JIRA)
Mar 25, 2010 at 7:24 pm
Mar 30, 2010 at 8:02 pm

1	[ANNOUCEMENT] Pig & Hadoop Contributors Workshop at Yahoo!

Hello Hadoop Contributors, The Yahoo Hadoop Development team would like to invite you to a Contributors Workshop for Hadoop Core (HDFS & Map-Reduce) and another for Pig on the day following the ...

Owen O'Malley
Mar 25, 2010 at 5:21 pm
Mar 25, 2010 at 9:17 pm

1	posted again: how are the splits for map tasks computed?

I realized that I made a mistake in my earlier post. So here is the correct one. I have a job ("loadgen") with only 1 input (say) part-00000 of size 1368654 bytes. So when I submit this job, I get ...

Abhishek sharma
Mar 25, 2010 at 2:27 am
Mar 25, 2010 at 4:33 am

1	[jira] Created: (HADOOP-6646) Move HarfileSystem out of Hadoop Common.

Move HarfileSystem out of Hadoop Common. ---------------------------------------- Key: HADOOP-6646 URL: https://issues.apache.org/jira/browse/HADOOP-6646 Project: Hadoop Common Issue Type: Bug ...

Mahadev konar (JIRA)
Mar 19, 2010 at 6:28 pm
Mar 24, 2010 at 9:45 pm

1	produce map/reduce on multiple files

Hi , All examples that I found executes mapreduce job on a single file but in my situation I have more than one. Suppose I have such folder on HDFS which contains some files: ...

Oleg Ruchovets
Mar 23, 2010 at 10:08 am
Mar 24, 2010 at 1:50 am

1	[jira] Created: (HADOOP-6645) Bugs on listStatus for HarFileSystem

Bugs on listStatus for HarFileSystem ------------------------------------ Key: HADOOP-6645 URL: https://issues.apache.org/jira/browse/HADOOP-6645 Project: Hadoop Common Issue Type: Bug Affects ...

Rodrigo Schmidt (JIRA)
Mar 19, 2010 at 8:51 am
Mar 23, 2010 at 8:01 pm

1	[jira] Created: (HADOOP-6655) SLA related changes in hadoop-policy.xml have misleading property descriptions

SLA related changes in hadoop-policy.xml have misleading property descriptions ------------------------------------------------------------------------------ Key: HADOOP-6655 URL: ...

Konstantin Boudnik (JIRA)
Mar 22, 2010 at 9:09 pm
Mar 23, 2010 at 5:14 pm

1	[jira] Created: (HADOOP-6617) Version 0.20.2 is not published on the maven repositories

Version 0.20.2 is not published on the maven repositories --------------------------------------------------------- Key: HADOOP-6617 URL: https://issues.apache.org/jira/browse/HADOOP-6617 Project: ...

Benson Margulies (JIRA)
Mar 5, 2010 at 6:01 pm
Mar 21, 2010 at 10:32 pm

1	[jira] Created: (HADOOP-6639) FileSystem.get(..) may be blocked for a long time

FileSystem.get(..) may be blocked for a long time ------------------------------------------------- Key: HADOOP-6639 URL: https://issues.apache.org/jira/browse/HADOOP-6639 Project: Hadoop Common ...

Tsz Wo (Nicholas), SZE (JIRA)
Mar 17, 2010 at 10:59 pm
Mar 17, 2010 at 11:19 pm

1	Hadoop Pipes Exception: Illegal text protocol command with BASH4

Hi, I am reopening an old thread concerning hadoop pipes. I am trying to run the hadoop pipes example with one master and one slave. However, I am having some problems with hadoop and environment ...

Mohamed Riadh Trad
Mar 1, 2010 at 2:56 pm
Mar 8, 2010 at 2:37 pm

1	[jira] Created: (HADOOP-6611) Fix javac warnings introduced by HADOOP-6584

Fix javac warnings introduced by HADOOP-6584 -------------------------------------------- Key: HADOOP-6611 URL: https://issues.apache.org/jira/browse/HADOOP-6611 Project: Hadoop Common Issue Type: ...

Jakob Homan (JIRA)
Mar 3, 2010 at 7:04 pm
Mar 3, 2010 at 7:08 pm

1	RE: Jobtrackers scalability

hai geeks, The functionality of the job tracker is to divide the job among the tasktrackers and monitor the progress of the task, and even the job also... Do we address a situation where we have ...

Kartik
Mar 3, 2010 at 8:55 am
Mar 3, 2010 at 1:15 pm

0	[jira] Created: (HADOOP-6670) UserGroupInformation doesn't support use in hash tables

UserGroupInformation doesn't support use in hash tables ------------------------------------------------------- Key: HADOOP-6670 URL: https://issues.apache.org/jira/browse/HADOOP-6670 Project: Hadoop ...

Owen O'Malley (JIRA)
Mar 31, 2010 at 11:36 pm
Mar 31, 2010 at 11:36 pm

0	[jira] Created: (HADOOP-6669) zlib.compress.level ignored for DefaultCodec initialization

zlib.compress.level ignored for DefaultCodec initialization ------------------------------------------------------------- Key: HADOOP-6669 URL: https://issues.apache.org/jira/browse/HADOOP-6669 ...

Koji Noguchi (JIRA)
Mar 31, 2010 at 10:34 pm
Mar 31, 2010 at 10:34 pm

0	[jira] Created: (HADOOP-6668) Apply audience and stability annotations to classes in common

Apply audience and stability annotations to classes in common ------------------------------------------------------------- Key: HADOOP-6668 URL: https://issues.apache.org/jira/browse/HADOOP-6668 ...

Tom White (JIRA)
Mar 31, 2010 at 8:45 pm
Mar 31, 2010 at 8:45 pm

0	[jira] Created: (HADOOP-6667) RPC.waitForProxy should retry through NoRouteToHostException

RPC.waitForProxy should retry through NoRouteToHostException ------------------------------------------------------------ Key: HADOOP-6667 URL: https://issues.apache.org/jira/browse/HADOOP-6667 ...

Todd Lipcon (JIRA)
Mar 31, 2010 at 8:19 pm
Mar 31, 2010 at 8:19 pm

0	[jira] Created: (HADOOP-6666) Introduce common logging mechanism to mark begin and end of test cases execution

Introduce common logging mechanism to mark begin and end of test cases execution -------------------------------------------------------------------------------- Key: HADOOP-6666 URL: ...

Konstantin Boudnik (JIRA)
Mar 31, 2010 at 5:46 am
Mar 31, 2010 at 5:46 am

0	CfP with Extended Deadline 5th Workshop on Virtualization in High-Performance Cloud Computing (VHPC'10)

Apologies if you received multiple copies of this message. ================================================================= CALL FOR PAPERS 5th Workshop on Virtualization in High-Performance Cloud ...

Michael Alexander
Mar 30, 2010 at 6:12 pm
Mar 30, 2010 at 6:12 pm

0	viewing text output from contrib/data_join example

Here are the contents of part-00000.deflate: [root@tyu-linux datajoin]# od output/part-00000.deflate 0000000 116170 152163 032113 162064 002164 043222 047234 111040 0000020 010713 142115 022030 ...

Ted Yu
Mar 30, 2010 at 5:45 pm
Mar 30, 2010 at 5:45 pm

0	how are the splits for map tasks computed?

Hi all, I have a job ("loadgen") with only 1 input (say) part-00000 of size 1368654 bytes. So when I submit this job, I get the following output: INFO mapred.FileInputFormat: Total input paths to ...

Abhishek sharma
Mar 25, 2010 at 2:20 am
Mar 25, 2010 at 2:20 am

0	[jira] Created: (HADOOP-6659) Switch RPC to use Avro

Switch RPC to use Avro ---------------------- Key: HADOOP-6659 URL: https://issues.apache.org/jira/browse/HADOOP-6659 Project: Hadoop Common Issue Type: Improvement Components: ipc Reporter: Doug ...

Doug Cutting (JIRA)
Mar 24, 2010 at 10:21 pm
Mar 24, 2010 at 10:21 pm

0	De-Duplication Technique

I have been researching ways to handle de-dupping data while running a map/reduce program (so as to not re-calculate/re-aggregate data that we have seen before[possibly months before]). The data sets ...

Joseph Stein
Mar 24, 2010 at 8:34 pm
Mar 24, 2010 at 8:34 pm

0	[jira] Created: (HADOOP-6658) Exclude Private elements from generated Javadoc

Exclude Private elements from generated Javadoc ----------------------------------------------- Key: HADOOP-6658 URL: https://issues.apache.org/jira/browse/HADOOP-6658 Project: Hadoop Common Issue ...

Tom White (JIRA)
Mar 24, 2010 at 4:14 am
Mar 24, 2010 at 4:14 am

0	[jira] Created: (HADOOP-6657) Common portion of MAPREDUCE-1545

Common portion of MAPREDUCE-1545 -------------------------------- Key: HADOOP-6657 URL: https://issues.apache.org/jira/browse/HADOOP-6657 Project: Hadoop Common Issue Type: Improvement Reporter: Luke ...

Luke Lu (JIRA)
Mar 24, 2010 at 12:30 am
Mar 24, 2010 at 12:30 am

0	[jira] Created: (HADOOP-6656) Security framework needs to renew Kerberos tickets while the process is running

Security framework needs to renew Kerberos tickets while the process is running ------------------------------------------------------------------------------- Key: HADOOP-6656 URL: ...

Owen O'Malley (JIRA)
Mar 23, 2010 at 6:48 am
Mar 23, 2010 at 6:48 am

0	BytesWritable modification

I recently modified Hadoop’s BytesWritable. The reason is that I developed BinaryInputOutputFormat. It has the LongWritable file offset as key and BytesWritable record as value. I parsed ...

이연희
Mar 22, 2010 at 4:39 pm
Mar 22, 2010 at 4:39 pm

0	[jira] Created: (HADOOP-6652) ShellBasedUnixGroupsMapping shouldn't have a cache

ShellBasedUnixGroupsMapping shouldn't have a cache -------------------------------------------------- Key: HADOOP-6652 URL: https://issues.apache.org/jira/browse/HADOOP-6652 Project: Hadoop Common ...

Devaraj Das (JIRA)
Mar 20, 2010 at 7:36 pm
Mar 20, 2010 at 7:36 pm

0	[jira] Created: (HADOOP-6651) Hadoop should provide a simplified way of fetching user-logs

Hadoop should provide a simplified way of fetching user-logs ------------------------------------------------------------ Key: HADOOP-6651 URL: https://issues.apache.org/jira/browse/HADOOP-6651 ...

Alok Singh (JIRA)
Mar 20, 2010 at 4:08 am
Mar 20, 2010 at 4:08 am

0	[jira] Created: (HADOOP-6650) Get rid of fakeBlockLocations() on HarFileSystem, since it's not used

Get rid of fakeBlockLocations() on HarFileSystem, since it's not used --------------------------------------------------------------------- Key: HADOOP-6650 URL: ...

Rodrigo Schmidt (JIRA)
Mar 20, 2010 at 1:36 am
Mar 20, 2010 at 1:36 am

0	[jira] Created: (HADOOP-6649) login object in UGI should be inside the subject

login object in UGI should be inside the subject ------------------------------------------------ Key: HADOOP-6649 URL: https://issues.apache.org/jira/browse/HADOOP-6649 Project: Hadoop Common Issue ...

Jitendra Nath Pandey (JIRA)
Mar 20, 2010 at 1:08 am
Mar 20, 2010 at 1:08 am

0	[jira] Created: (HADOOP-6648) Credentials should ignore null tokens

Credentials should ignore null tokens ------------------------------------- Key: HADOOP-6648 URL: https://issues.apache.org/jira/browse/HADOOP-6648 Project: Hadoop Common Issue Type: Bug Components: ...

Owen O'Malley (JIRA)
Mar 20, 2010 at 12:11 am
Mar 20, 2010 at 12:11 am

0	[jira] Created: (HADOOP-6647) balancer fails with "is not authorized for protocol interface NamenodeProtocol" in secure environment

balancer fails with "is not authorized for protocol interface NamenodeProtocol" in secure environment ...

Boris Shkolnik (JIRA)
Mar 19, 2010 at 8:28 pm
Mar 19, 2010 at 8:28 pm

0	[jira] Created: (HADOOP-6644) util.Shell getGROUPS_FOR_USER_COMMAND method name - should use common naming convention

util.Shell getGROUPS_FOR_USER_COMMAND method name - should use common naming convention --------------------------------------------------------------------------------------- Key: HADOOP-6644 URL: ...

Boris Shkolnik (JIRA)
Mar 19, 2010 at 6:25 am
Mar 19, 2010 at 6:25 am

group	common-dev @
categories	hadoop
discussions	97
posts	177
users	54
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > common-dev > March 2010

Search Discussions

97 discussions - 177 posts

54 users for March 2010

Content

People

Support

Translate