common-dev@hadoop.apache.org discussions for August 2010

11	HELP !!!! configuring hadoop on ECLIPSE

Hi All, How can i configure hadoop on eclipse for development purpose. I dont want to download hadoop from trunk and use svn. I have a stable hadoop 0.20.2 release tar file. I want to use this tar ...

Ahmad Shahzad
Aug 11, 2010 at 12:46 pm
Sep 5, 2011 at 10:42 am

9	RawComparator of BooleanWritable broken ?

Hi folks, i'm stumbled into a situation with hadoop-0.20.2 where sorting with a BooleanWritable doesn't work. I wrote some test and it seems to me that the raw-comparator version is the problem... ...

Johannes Zillmann
Aug 26, 2010 at 11:58 am
Aug 29, 2010 at 11:58 am

7	where distributed cache start working

Hi all, I go through the code, but couldn't find the place where distributed cache start working. I want to know between DistriubtedCache.addCacheFile at the master node and ...

Gang Luo
Aug 20, 2010 at 3:08 pm
Aug 27, 2010 at 2:05 pm

5	Use of RPC Server and Client...

Hi ALL, Can anyone tell me the purpose for RPC server and RPC client that is used in hadoop. As far as logs tell, they are used by JobTracker and TaskTracker, as well as namenode and datanode. Can ...

Ahmad Shahzad
Aug 12, 2010 at 11:39 pm
Aug 13, 2010 at 6:04 pm

4	[VOTE] Release Hadoop 0.21.0 (candidate 2)

I have created a new candidate build for Hadoop 0.21.0. This fixes MAPREDUCE-2012 and MAPREDUCE-2014 which were found for the previous release candidate (1). This release is being classified as a ...

Tom White
Aug 17, 2010 at 5:29 am
Aug 20, 2010 at 7:09 pm

3	hadoop ANT build ERROR HELP!!!!

Hi All, Can anyone guide me regarding this error, i get this error when i compile the hadoop with ant. one more thing, i just un tar the hadoop folder, so, i have changed nothing no code in hadoop ...

Ahmad Shahzad
Aug 3, 2010 at 11:27 am
Sep 16, 2010 at 5:40 am

3	[ANNOUNCE] Apache Hadoop 0.21.0 released

Hi everyone, I am pleased to announce that Apache Hadoop 0.21.0 is available for download from http://hadoop.apache.org/common/releases.html. Over 1300 issues have been addressed since 0.20.2; you ...

Tom White
Aug 24, 2010 at 7:19 pm
Sep 15, 2010 at 3:58 pm

2	[jira] Created: (HADOOP-6927) Herriot NN and DN clients should vend statistics

Herriot NN and DN clients should vend statistics ------------------------------------------------ Key: HADOOP-6927 URL: https://issues.apache.org/jira/browse/HADOOP-6927 Project: Hadoop Common Issue ...

Al Thompson (JIRA)
Aug 26, 2010 at 4:49 pm
Sep 3, 2010 at 3:09 am

2	[VOTE] Release Hadoop 0.21.0 (candidate 1)

I have created a new candidate build for Hadoop 0.21.0. This fixes MAPREDUCE-1920 and MAPREDUCE-1926 which were found for the previous release candidate (0). This release is being classified as a ...

Tom White
Aug 13, 2010 at 9:05 pm
Aug 15, 2010 at 4:33 am

2	Jira task 6891

Sent from my iPad

Hotmail Email Address
Aug 13, 2010 at 2:50 am
Aug 13, 2010 at 5:01 am

2

JIRA 6891

Hi Folks,I am nearing completion for JIRA 6891 and had a question. I have written a Junit test suite using junit 4 that drives all the examples. This is currently working inside Eclipse and I will be ...

Saikat Kanjilal
Aug 11, 2010 at 4:30 am
Aug 11, 2010 at 1:26 pm

2	Checksum of blocks

Hello all, (http://hadoop.apache.org/common/docs/current/hdfs_design.html): "When a client creates an HDFS file, it computes a checksum of each block of the file and stores these checksums in a ...

Gautam Singaraju
Aug 1, 2010 at 5:11 am
Aug 3, 2010 at 3:59 pm

1	[jira] Created: (HADOOP-6917) Remove empty FTPFileSystemConfigKeys.java file

Remove empty FTPFileSystemConfigKeys.java file ---------------------------------------------- Key: HADOOP-6917 URL: https://issues.apache.org/jira/browse/HADOOP-6917 Project: Hadoop Common Issue ...

Tom White (JIRA)
Aug 20, 2010 at 6:29 pm
Nov 3, 2010 at 10:23 pm

1	Replacing IPC NIO with Simple Sockets

Hi All, I want to replace the code in Server.java class of hadoop/ipc with my own socket factory code. The point is that right now what i see in server.java is that it uses NIO package and ...

Ahmad Shahzad
Aug 25, 2010 at 9:46 am
Aug 25, 2010 at 1:48 pm

1	[jira] Created: (HADOOP-6923) Native Libraries do not load if a different platform signature is returned from org.apache.hadoop.util.PlatformName

Native Libraries do not load if a different platform signature is returned from org.apache.hadoop.util.PlatformName ...

Stephen Watt (JIRA)
Aug 24, 2010 at 7:50 pm
Aug 25, 2010 at 1:46 pm

1	Intro / Ideas for contribution

Hi list, I'd like to start contributing to hadoop. I've spend the last couple of days reading through documentation / guidelines, setting up my development environment etc. Now I was thinking the ...

Bern Hassmo
Aug 12, 2010 at 12:59 pm
Aug 12, 2010 at 11:48 pm

1	[jira] Created: (HADOOP-6900) FileSystem#listLocatedStatus API needs changes to indicate complete set of error conditions

FileSystem#listLocatedStatus API needs changes to indicate complete set of error conditions ------------------------------------------------------------------------------------------- Key: ...

Suresh Srinivas (JIRA)
Aug 4, 2010 at 11:31 pm
Aug 11, 2010 at 4:46 am

1	[jira] Created: (HADOOP-6911) doc update for DelegationTokenFetcher (part of HDFS-1036)

doc update for DelegationTokenFetcher (part of HDFS-1036) --------------------------------------------------------- Key: HADOOP-6911 URL: https://issues.apache.org/jira/browse/HADOOP-6911 Project: ...

Boris Shkolnik (JIRA)
Aug 10, 2010 at 5:41 pm
Aug 10, 2010 at 10:43 pm

1	2 General questions - NameNode SPOF, Byzantine fault tolerance

Hi, New to Hadoop. Learning the architecture, code, ecosystem and everything else... love what I've seen so far. Some parts are brilliant. I've been wondering. If the NameNode is a single point of ...

Maxim Veksler
Aug 3, 2010 at 8:35 am
Aug 7, 2010 at 3:18 am

1	hadoop JobTRACKER error HELP!!!

Hi ALL, I am getting this error in JobTracker's log file. But when i format my namenode the error doesnt comes. But i can run hadoop only once. If i run it the second time the same error comes. Any ...

Ahmad Shahzad
Aug 4, 2010 at 6:33 pm
Aug 7, 2010 at 3:10 am

1	sockets in hadoop

Hi ALL, Can anyone tell me the purpose of sockets used in hadoop. I mean for which purpose hadoop uses sockets? are they used by tasktracker and jobtrackers ? or used by namenode and datanode ? ...

Ahmad Shahzad
Aug 2, 2010 at 11:51 am
Aug 3, 2010 at 4:25 am

0	data distribution

Hi, Can you please provide pointers (your experience plus location in the code) to look for: a) For a given job: how the data is provided to a specific task-tracker for the mr computation. (consider ...

Himanshu Vashishtha
Aug 29, 2010 at 6:03 am
Aug 29, 2010 at 6:03 am

0	[jira] Created: (HADOOP-6934) test for ByteWritable comparator

test for ByteWritable comparator -------------------------------- Key: HADOOP-6934 URL: https://issues.apache.org/jira/browse/HADOOP-6934 Project: Hadoop Common Issue Type: Test Components: record ...

Johannes Zillmann (JIRA)
Aug 28, 2010 at 5:50 pm
Aug 28, 2010 at 5:50 pm

0	[jira] Created: (HADOOP-6933) TestListFiles is flaky

TestListFiles is flaky ---------------------- Key: HADOOP-6933 URL: https://issues.apache.org/jira/browse/HADOOP-6933 Project: Hadoop Common Issue Type: Bug Components: test Affects Versions: 0.22.0 ...

Todd Lipcon (JIRA)
Aug 27, 2010 at 10:04 pm
Aug 27, 2010 at 10:04 pm

0	[jira] Created: (HADOOP-6931) Namenode start (init) fails because of invalid kerberos key, even when security set to "simple"

Namenode start (init) fails because of invalid kerberos key, even when security set to "simple" ----------------------------------------------------------------------------------------------- Key: ...

Boris Shkolnik (JIRA)
Aug 26, 2010 at 9:13 pm
Aug 26, 2010 at 9:13 pm

0	[jira] Created: (HADOOP-6930) AvroRpcEngine doesn't work with generated Avro code

AvroRpcEngine doesn't work with generated Avro code --------------------------------------------------- Key: HADOOP-6930 URL: https://issues.apache.org/jira/browse/HADOOP-6930 Project: Hadoop Common ...

Sharad Agarwal (JIRA)
Aug 26, 2010 at 9:04 pm
Aug 26, 2010 at 9:04 pm

0	[jira] Created: (HADOOP-6929) RPC should have a way to pass Security information other than protocol annotations

RPC should have a way to pass Security information other than protocol annotations ---------------------------------------------------------------------------------- Key: HADOOP-6929 URL: ...

Sharad Agarwal (JIRA)
Aug 26, 2010 at 8:49 pm
Aug 26, 2010 at 8:49 pm

0	[jira] Created: (HADOOP-6928) Fix BooleanWritable comparator in 0.20

Fix BooleanWritable comparator in 0.20 -------------------------------------- Key: HADOOP-6928 URL: https://issues.apache.org/jira/browse/HADOOP-6928 Project: Hadoop Common Issue Type: Bug ...

Owen O'Malley (JIRA)
Aug 26, 2010 at 4:53 pm
Aug 26, 2010 at 4:53 pm

0	[jira] Created: (HADOOP-6926) SocketInputStream incorrectly implements read()

SocketInputStream incorrectly implements read() ----------------------------------------------- Key: HADOOP-6926 URL: https://issues.apache.org/jira/browse/HADOOP-6926 Project: Hadoop Common Issue ...

Todd Lipcon (JIRA)
Aug 24, 2010 at 10:41 pm
Aug 24, 2010 at 10:41 pm

0	[jira] Created: (HADOOP-6925) BZip2Codec incorrectly implements read()

BZip2Codec incorrectly implements read() ---------------------------------------- Key: HADOOP-6925 URL: https://issues.apache.org/jira/browse/HADOOP-6925 Project: Hadoop Common Issue Type: Bug ...

Todd Lipcon (JIRA)
Aug 24, 2010 at 10:11 pm
Aug 24, 2010 at 10:11 pm

0	[jira] Created: (HADOOP-6924) Build fails with non-Sun JREs due to different pathing to the operating system architecture shared libraries

Build fails with non-Sun JREs due to different pathing to the operating system architecture shared libraries ...

Stephen Watt (JIRA)
Aug 24, 2010 at 8:48 pm
Aug 24, 2010 at 8:48 pm

0	[jira] Created: (HADOOP-6922) COMMON part of MAPREDUCE-1664

COMMON part of MAPREDUCE-1664 ----------------------------- Key: HADOOP-6922 URL: https://issues.apache.org/jira/browse/HADOOP-6922 Project: Hadoop Common Issue Type: Bug Reporter: Ravi Gummadi ...

Ravi Gummadi (JIRA)
Aug 24, 2010 at 9:17 am
Aug 24, 2010 at 9:17 am

0	[jira] Created: (HADOOP-6921) metrics2: metrics plugins

metrics2: metrics plugins ------------------------- Key: HADOOP-6921 URL: https://issues.apache.org/jira/browse/HADOOP-6921 Project: Hadoop Common Issue Type: Sub-task Affects Versions: 0.20.2 ...

Luke Lu (JIRA)
Aug 23, 2010 at 9:06 pm
Aug 23, 2010 at 9:06 pm

0	[jira] Created: (HADOOP-6920) Metrics2: metrics instrumentation

Metrics2: metrics instrumentation --------------------------------- Key: HADOOP-6920 URL: https://issues.apache.org/jira/browse/HADOOP-6920 Project: Hadoop Common Issue Type: Sub-task Affects ...

Luke Lu (JIRA)
Aug 23, 2010 at 9:01 pm
Aug 23, 2010 at 9:01 pm

0	[jira] Created: (HADOOP-6919) Metrics2: metrics framework

Metrics2: metrics framework --------------------------- Key: HADOOP-6919 URL: https://issues.apache.org/jira/browse/HADOOP-6919 Project: Hadoop Common Issue Type: Sub-task Components: metrics Affects ...

Luke Lu (JIRA)
Aug 23, 2010 at 8:53 pm
Aug 23, 2010 at 8:53 pm

0	[jira] Created: (HADOOP-6918) jjjjjjjjj

jjjjjjjjj --------- Key: HADOOP-6918 URL: https://issues.apache.org/jira/browse/HADOOP-6918 Project: Hadoop Common Issue Type: Improvement Reporter: Luke Lu -- This message is automatically generated ...

Luke Lu (JIRA)
Aug 23, 2010 at 5:00 pm
Aug 23, 2010 at 5:00 pm

0	read directory

Hi guys how is it going ? So, i have a doubt. I' d like connect to hadoop hdfs using java and read all files from a directory, but i just was able to connect to hadoop hdfs and read only a file. ...

Thiago Veiga
Aug 23, 2010 at 4:47 pm
Aug 23, 2010 at 4:47 pm

0	[jira] Created: (HADOOP-6916) Implement append operation for S3FileSystem

Implement append operation for S3FileSystem ------------------------------------------- Key: HADOOP-6916 URL: https://issues.apache.org/jira/browse/HADOOP-6916 Project: Hadoop Common Issue Type: Bug ...

Oleg Aleshko (JIRA)
Aug 16, 2010 at 2:34 pm
Aug 16, 2010 at 2:34 pm

0	[jira] Resolved: (HADOOP-5303) Oozie, Hadoop Workflow System

[ https://issues.apache.org/jira/browse/HADOOP-5303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved HADOOP-5303. ...

Alejandro Abdelnur (JIRA)
Aug 13, 2010 at 7:38 am
Aug 13, 2010 at 7:38 am

0	SOCKET FACTORIES problem.... HELP!!

Hi ALL, Does hadoop uses socket factories given in org/apache/hadoop/net folder for creating every socket it uses??? I was looking at the code of RPC Server in ipc directory. It creates a ...

Ahmad Shahzad
Aug 12, 2010 at 11:51 pm
Aug 12, 2010 at 11:51 pm

0	[jira] Created: (HADOOP-6915) Add daemon restart option

Add daemon restart option ------------------------- Key: HADOOP-6915 URL: https://issues.apache.org/jira/browse/HADOOP-6915 Project: Hadoop Common Issue Type: Improvement Components: scripts ...

Nicolas Spiegelberg (JIRA)
Aug 12, 2010 at 10:00 pm
Aug 12, 2010 at 10:00 pm

0	[jira] Created: (HADOOP-6914) IPC Client Connection close does not protect against partially Connection objects

IPC Client Connection close does not protect against partially Connection objects --------------------------------------------------------------------------------- Key: HADOOP-6914 URL: ...

Richard Lackey (JIRA)
Aug 12, 2010 at 8:52 pm
Aug 12, 2010 at 8:52 pm

0	<no subject>

Jothi Padmanabhan
Aug 12, 2010 at 10:45 am
Aug 12, 2010 at 10:45 am

0	[jira] Created: (HADOOP-6913) Circular initialization between UserGroupInformation and KerberosName

Circular initialization between UserGroupInformation and KerberosName --------------------------------------------------------------------- Key: HADOOP-6913 URL: ...

Kan Zhang (JIRA)
Aug 11, 2010 at 6:16 pm
Aug 11, 2010 at 6:16 pm

0

Response

Saikat Kanjilal
Aug 11, 2010 at 2:41 pm
Aug 11, 2010 at 2:41 pm

0	[jira] Created: (HADOOP-6912) Guard against NPE when calling UGI.isLoginKeytabBased()

Guard against NPE when calling UGI.isLoginKeytabBased() ------------------------------------------------------- Key: HADOOP-6912 URL: https://issues.apache.org/jira/browse/HADOOP-6912 Project: Hadoop ...

Kan Zhang (JIRA)
Aug 10, 2010 at 9:50 pm
Aug 10, 2010 at 9:50 pm

0	[jira] Created: (HADOOP-6910) Replace or merge Configuration with Jakarta Commons Configuration

Replace or merge Configuration with Jakarta Commons Configuration ----------------------------------------------------------------- Key: HADOOP-6910 URL: ...

Jeff Hammerbacher (JIRA)
Aug 10, 2010 at 4:43 pm
Aug 10, 2010 at 4:43 pm

0	[jira] Created: (HADOOP-6909) Umbrella ticket for reducing the number of libraries in Common

Umbrella ticket for reducing the number of libraries in Common -------------------------------------------------------------- Key: HADOOP-6909 URL: https://issues.apache.org/jira/browse/HADOOP-6909 ...

Jeff Hammerbacher (JIRA)
Aug 10, 2010 at 4:41 pm
Aug 10, 2010 at 4:41 pm

0	[jira] Created: (HADOOP-6908) Provide a "-y" option that skips the confirmation question of the namenode for use in scripts.

Provide a "-y" option that skips the confirmation question of the namenode for use in scripts. ---------------------------------------------------------------------------------------------- Key: ...

Mathias Gug (JIRA)
Aug 9, 2010 at 10:16 pm
Aug 9, 2010 at 10:16 pm

0	[jira] Created: (HADOOP-6907) Rpc client doesn't use the per-connection conf to figure out server's Kerberos principal

Rpc client doesn't use the per-connection conf to figure out server's Kerberos principal ---------------------------------------------------------------------------------------- Key: HADOOP-6907 URL: ...

Kan Zhang (JIRA)
Aug 9, 2010 at 9:37 pm
Aug 9, 2010 at 9:37 pm

group	common-dev @
categories	hadoop
discussions	65
posts	124
users	32
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > common-dev > August 2010

Search Discussions

65 discussions - 124 posts

32 users for August 2010

Content

People

Support

Translate