common-dev@hadoop.apache.org discussions for March 2011

7	pointers to Hadoop eclipse

Hi, Can someone please point to any good reference that tells clearly how to checkout Hadoop code base in eclipse, make any changes and re-compile. Actually, I wanted to change some part in Hadoop, ...

Bikash sharma
Mar 17, 2011 at 2:47 pm
Mar 18, 2011 at 12:52 am

6	VOTE: Committing HADOOP-6949 to 0.22 branch

HADOOP-6949 introduced a very important optimization to the RPC layer. Based on the benchmarks presented in HDFS-1583 this provides an order of magnitude improvement of current RPC implementation. ...

Konstantin Shvachko
Mar 29, 2011 at 4:40 am
Mar 30, 2011 at 1:08 am

6	File formats in Hadoop

I am browsing through the hadoop.io package and was wondering what other file formats are available in hadoop other than SequenceFile and TFile? Is all data written through hadoop including those ...

Weishung Chung
Mar 19, 2011 at 4:02 pm
Mar 24, 2011 at 12:16 am

4	File access pattern on HDFS?

Hi, Is there a mechanism to get the list of files accessed on HDFS at the NameNode? Thanks! --- Gautam

Gautam Singaraju
Mar 6, 2011 at 10:31 pm
Mar 8, 2011 at 4:53 am

3	[jira] [Created] (HADOOP-7206) Integrate Snappy compression

Integrate Snappy compression ---------------------------- Key: HADOOP-7206 URL: https://issues.apache.org/jira/browse/HADOOP-7206 Project: Hadoop Common Issue Type: New Feature Reporter: Eli Collins ...

Eli Collins (JIRA)
Mar 22, 2011 at 11:46 pm
Jun 23, 2011 at 1:03 am

3	MapReduce compilation error

Hi, When I am compiling MapReduce source code after checking-in Eclipse, I am getting the following error: The declared package "" does not match the expected package "testjar" ...

Bikash sharma
Mar 18, 2011 at 8:09 pm
May 18, 2011 at 8:13 pm

3	Hadoop Version 0.20.2, 0.20.100 and 0.21.0.

Hi, I'm quite confused of the status and future of recent Hadoop versions. 0.21.0 has not been declared production ready. Is there plan to make it production ready? If not, what is the next release ...

Jane Chen
Mar 16, 2011 at 8:07 pm
Mar 17, 2011 at 9:00 pm

3	Can we specify the map task capacity value for each node ?

Thanks in advance xyang

Xi yang
Mar 12, 2011 at 4:41 pm
Mar 12, 2011 at 5:56 pm

3	Hadoop-Common-trunk-Commit - Build # 518 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Common-trunk-Commit/518/ ################################################################################### ########################## LAST 60 LINES ...

Apache Hudson Server
Mar 7, 2011 at 3:22 am
Mar 8, 2011 at 1:42 am

3	Massive checkin to hadoop-0.20-security-patches

I'm about to push the broken apart hadoop-0.20-security into hadoop-0.20-security-patches. It is 863 patches for the main branch. There are two release branches off of it that have a few patches ...

Owen O'Malley
Mar 3, 2011 at 11:29 pm
Mar 8, 2011 at 1:01 am

2	google snappy

Hey my fellow hadoop/hbase developers, I just came across this google compression/decompression package yesterday, could we make a good use of this compression scheme in hadoop? It's written in C++ ...

Weishung Chung
Mar 23, 2011 at 7:46 pm
Mar 23, 2011 at 7:54 pm

2	Sync-marker in uncompressed sequenceFile

Hello my fellow Hadoop users/developers, I'm reading the SequenceFile source code, and there is a checkAndWriteSync() method that writes a sync marker every so many bytes. I was wondering what's the ...

Weishung Chung
Mar 21, 2011 at 2:41 pm
Mar 22, 2011 at 2:16 pm

2	How to contribute to hadoop?

Hi All, I m newbie to hadoop and very much interested to learn and contibute.. Please guide/show me the path , from where should i start? Basically i m a java programmer. Thanks Shant -- Life is Just ...

Shant.....
Mar 21, 2011 at 6:59 pm
Mar 22, 2011 at 10:48 am

2	disable pipelining in Hadoop

Hi, Is there a way to disable the use of pipelining , i.e., the reduce phase is started only after the map phase is completed? -bikash

Bikash sharma
Mar 1, 2011 at 2:14 pm
Mar 12, 2011 at 6:05 pm

2	[jira] Created: (HADOOP-7167) Allow using a file to exclude certain tests from build

Allow using a file to exclude certain tests from build ------------------------------------------------------ Key: HADOOP-7167 URL: https://issues.apache.org/jira/browse/HADOOP-7167 Project: Hadoop ...

Todd Lipcon (JIRA)
Mar 7, 2011 at 10:42 pm
Mar 12, 2011 at 12:25 am

2	Hadoop-Common-trunk-Commit - Build # 514 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Common-trunk-Commit/514/ ################################################################################### ########################## LAST 60 LINES ...

Apache Hudson Server
Mar 2, 2011 at 8:21 pm
Mar 4, 2011 at 9:53 pm

2	conceptual question regarding slots

Hi, Could someone throw some light as to how intuitively fixed-type slots in Hadoop have a negative impact of cluster utilization as mentioned in Arun's blog? ...

Bikash sharma
Mar 2, 2011 at 1:34 pm
Mar 3, 2011 at 12:20 am

1	[jira] Created: (HADOOP-7176) Redesign FsShell

Redesign FsShell ---------------- Key: HADOOP-7176 URL: https://issues.apache.org/jira/browse/HADOOP-7176 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.22.0 Reporter: Daryn Sharp Fix ...

Daryn Sharp (JIRA)
Mar 9, 2011 at 7:44 pm
Apr 16, 2012 at 1:46 pm

1	[jira] [Created] (HADOOP-7211) Security uses proprietary Sun APIs

Security uses proprietary Sun APIs ---------------------------------- Key: HADOOP-7211 URL: https://issues.apache.org/jira/browse/HADOOP-7211 Project: Hadoop Common Issue Type: Improvement Reporter: ...

Eli Collins (JIRA)
Mar 28, 2011 at 9:54 pm
Apr 6, 2012 at 5:32 am

1	[jira] Created: (HADOOP-7163) "java.net.SocketTimeoutException: 60000 millis timeout" happens a lot

"java.net.SocketTimeoutException: 60000 millis timeout" happens a lot --------------------------------------------------------------------- Key: HADOOP-7163 URL: ...

Owen O'Malley (JIRA)
Mar 4, 2011 at 5:20 pm
Aug 25, 2011 at 8:16 pm

1	[jira] Created: (HADOOP-7179) Improve HDFS startup scripts

Improve HDFS startup scripts ---------------------------- Key: HADOOP-7179 URL: https://issues.apache.org/jira/browse/HADOOP-7179 Project: Hadoop Common Issue Type: Improvement Components: scripts ...

Tanping Wang (JIRA)
Mar 10, 2011 at 8:11 pm
May 3, 2011 at 9:21 pm

1	[jira] Created: (HADOOP-7170) Support UGI in FileContext API

Support UGI in FileContext API ------------------------------ Key: HADOOP-7170 URL: https://issues.apache.org/jira/browse/HADOOP-7170 Project: Hadoop Common Issue Type: Bug Components: security ...

Owen O'Malley (JIRA)
Mar 8, 2011 at 12:51 am
May 2, 2011 at 10:47 pm

1	[jira] [Created] (HADOOP-7212) Reuse connection

Reuse connection ---------------- Key: HADOOP-7212 URL: https://issues.apache.org/jira/browse/HADOOP-7212 Project: Hadoop Common Issue Type: Bug Components: ipc Reporter: Hairong Kuang Assignee: ...

Hairong Kuang (JIRA)
Mar 30, 2011 at 12:04 am
Mar 30, 2011 at 6:51 am

1	Isolation Runner not working as expected?

Hi, I would like to know if any one has used isolation runner for debugging? I have tried a lot but it is not at all working? My steps are as follows: 1. In the mapper function i have created an ...

Som_shekhar
Mar 29, 2011 at 1:33 pm
Mar 29, 2011 at 5:30 pm

1	[jira] [Created] (HADOOP-7202) Improve Command base class

Improve Command base class -------------------------- Key: HADOOP-7202 URL: https://issues.apache.org/jira/browse/HADOOP-7202 Project: Hadoop Common Issue Type: Improvement Affects Versions: 0.22.0 ...

Daryn Sharp (JIRA)
Mar 21, 2011 at 6:31 pm
Mar 29, 2011 at 12:36 am

1	RecordReader

Hello, I have a specific RecordReder, named XRR. I would like iterate on split and create records. Thus, need to position its start attribute. I dont have enough info from InputSplit. Interface for ...

Keren Ouaknine
Mar 23, 2011 at 8:55 pm
Mar 23, 2011 at 8:59 pm

1	Is there any way to add jar when invoking hadoop command

Hi all, When I use command "hadoop fs -text" I need to add extra jar to CLASSPATH, because there's custom type in my sequence file. One way is that copying jar to $HADOOP_HOME/lib But in my case, I ...

Jeff Zhang
Mar 23, 2011 at 1:19 am
Mar 23, 2011 at 1:35 am

1	Unable to connect to the url

Hi, I am using a standalone linux machine. Namenode and Datanode are running. But when I try to access the UI in my browser its showing "unable to connect" error. I know its a basic question please ...

James Ram
Mar 18, 2011 at 5:01 am
Mar 22, 2011 at 8:03 pm

1	[jira] Created: (HADOOP-7201) Add Cassandra to list of Hadoop-related projects at Apache

Add Cassandra to list of Hadoop-related projects at Apache ---------------------------------------------------------- Key: HADOOP-7201 URL: https://issues.apache.org/jira/browse/HADOOP-7201 Project: ...

Jonathan Ellis (JIRA)
Mar 20, 2011 at 12:52 am
Mar 20, 2011 at 9:24 pm

1	modification to Hadoop Jobtracker

Hi, For my research project, I need to modify Hadoop JobTracker to collect some statistics of TaskTracker nodes. For example, I would like to piggy-back heartbeat messages sent from TaskTrackers to ...

Bikash sharma
Mar 18, 2011 at 5:59 pm
Mar 18, 2011 at 6:12 pm

1	Hadoop Testing?

Dear Friends, I am Anandkumar, working as a test engineer in eBay and we use Hadoop extensively to store our log. I am in situation to validate or test our Data perfectly reaching the Hadoop ...

Anandkumar R
Mar 17, 2011 at 6:43 pm
Mar 18, 2011 at 4:59 am

1	Frustrating "pending" statuses

Despite plenty of available mapper slots (as inferred by "Map Task Capacity" minus "Maps" on the jobtracker) our jobs often linger with all or many of the map tasks stuck in a pending status for five ...

Keith Wiley
Mar 15, 2011 at 1:33 pm
Mar 15, 2011 at 4:43 pm

1	Hadoop-Common-22-branch - Build # 30 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Common-22-branch/30/ ################################################################################### ########################## LAST 60 LINES OF ...

Apache Hudson Server
Mar 5, 2011 at 9:34 am
Mar 9, 2011 at 9:34 am

0	[jira] [Created] (HADOOP-7215) RPC clients must connect over a network interface corresponding to the host name in the client's kerberos principal key

RPC clients must connect over a network interface corresponding to the host name in the client's kerberos principal key ...

Suresh Srinivas (JIRA)
Mar 31, 2011 at 1:13 am
Mar 31, 2011 at 1:13 am

0	[jira] [Created] (HADOOP-7214) Hadoop /usr/bin/groups equivalent

Hadoop /usr/bin/groups equivalent --------------------------------- Key: HADOOP-7214 URL: https://issues.apache.org/jira/browse/HADOOP-7214 Project: Hadoop Common Issue Type: New Feature Affects ...

Aaron T. Myers (JIRA)
Mar 30, 2011 at 4:20 pm
Mar 30, 2011 at 4:20 pm

0	[jira] [Created] (HADOOP-7213) document multiple keys per reducer oddity in hadoop streaming FAQ

document multiple keys per reducer oddity in hadoop streaming FAQ ----------------------------------------------------------------- Key: HADOOP-7213 URL: ...

Dieter Plaetinck (JIRA)
Mar 30, 2011 at 7:54 am
Mar 30, 2011 at 7:54 am

0	how to get each task's process?

hi,guys: I want to monitor each tasks' io usage, do can I get each task's process id? I used jvmManager.getPid(tip.getTaskRunner()); but it didn't seem to be the task's process. Thanks zhutao

朱韬
Mar 29, 2011 at 2:53 pm
Mar 29, 2011 at 2:53 pm

0	Setting up Hadoop in Eclipse

Hi list, I am having problems setting up Hadoop for Eclipse. I followed the instructions under: http://wiki.apache.org/hadoop/EclipseEnvironment Since I want to debug MapReduce jobs in distributed ...

David Saile
Mar 29, 2011 at 1:56 pm
Mar 29, 2011 at 1:56 pm

0	Hadoop-Common-21-Build - Build # 118 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Common-21-Build/118/ ################################################################################### ########################## LAST 60 LINES OF ...

Apache Hudson Server
Mar 28, 2011 at 9:34 pm
Mar 28, 2011 at 9:34 pm

0	[jira] [Created] (HADOOP-7210) Chown command is not working from FSShell.

Chown command is not working from FSShell. ------------------------------------------ Key: HADOOP-7210 URL: https://issues.apache.org/jira/browse/HADOOP-7210 Project: Hadoop Common Issue Type: Bug ...

Uma Maheswara Rao G (JIRA)
Mar 28, 2011 at 4:35 pm
Mar 28, 2011 at 4:35 pm

0	observe the effect of changes to Hadoop

Hi, For my research project, I need to add a couple of functions in JobTracker.java source file to include additional information about TaskTrackers resource usage through heartbeat messages. I made ...

Bikash sharma
Mar 25, 2011 at 2:10 pm
Mar 25, 2011 at 2:10 pm

0	Hadoop-Common-21-Build - Build # 116 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Common-21-Build/116/ ################################################################################### ########################## LAST 60 LINES OF ...

Apache Hudson Server
Mar 24, 2011 at 9:33 pm
Mar 24, 2011 at 9:33 pm

0	[jira] [Created] (HADOOP-7208) equals() and hashCode() implementation need to change in StandardSocketFactory

equals() and hashCode() implementation need to change in StandardSocketFactory ------------------------------------------------------------------------------ Key: HADOOP-7208 URL: ...

Uma Maheswara Rao G (JIRA)
Mar 23, 2011 at 2:50 pm
Mar 23, 2011 at 2:50 pm

0	Hadoop-Common-trunk - Build # 639 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Common-trunk/639/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Hudson Server
Mar 23, 2011 at 12:55 pm
Mar 23, 2011 at 12:55 pm

0	[jira] [Created] (HADOOP-7207) fs member of FSShell is not really needed

fs member of FSShell is not really needed ----------------------------------------- Key: HADOOP-7207 URL: https://issues.apache.org/jira/browse/HADOOP-7207 Project: Hadoop Common Issue Type: Bug ...

Boris Shkolnik (JIRA)
Mar 23, 2011 at 12:32 am
Mar 23, 2011 at 12:32 am

0	[jira] [Resolved] (HADOOP-5983) Namenode shouldn't read mapred-site.xml

[ https://issues.apache.org/jira/browse/HADOOP-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HADOOP-5983. --------------------------------- Resolution: ...

Daryn Sharp (JIRA)
Mar 22, 2011 at 6:56 pm
Mar 22, 2011 at 6:56 pm

0	[jira] [Created] (HADOOP-7205) automatically determine JAVA_HOME on OS X

automatically determine JAVA_HOME on OS X ----------------------------------------- Key: HADOOP-7205 URL: https://issues.apache.org/jira/browse/HADOOP-7205 Project: Hadoop Common Issue Type: ...

Daryn Sharp (JIRA)
Mar 22, 2011 at 6:34 pm
Mar 22, 2011 at 6:34 pm

0	[jira] [Created] (HADOOP-7204) remove local unused fs variable from CmdHandler and FsShellPermissions.changePermissions

remove local unused fs variable from CmdHandler and FsShellPermissions.changePermissions ---------------------------------------------------------------------------------------- Key: HADOOP-7204 URL: ...

Boris Shkolnik (JIRA)
Mar 21, 2011 at 10:27 pm
Mar 21, 2011 at 10:27 pm

0	[jira] [Created] (HADOOP-7203) Folder Paths

Folder Paths ------------ Key: HADOOP-7203 URL: https://issues.apache.org/jira/browse/HADOOP-7203 Project: Hadoop Common Issue Type: Bug Components: build Affects Versions: 0.21.0 Environment: Mac OS ...

Anastasis Andronidis (JIRA)
Mar 21, 2011 at 8:03 pm
Mar 21, 2011 at 8:03 pm

0	[jira] Created: (HADOOP-7200) Hudson should cover fault inject compilation

Hudson should cover fault inject compilation --------------------------------------------- Key: HADOOP-7200 URL: https://issues.apache.org/jira/browse/HADOOP-7200 Project: Hadoop Common Issue Type: ...

Eli Collins (JIRA)
Mar 18, 2011 at 9:49 pm
Mar 18, 2011 at 9:49 pm

group	common-dev @
categories	hadoop
discussions	89
posts	157
users	46
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > common-dev > March 2011

Search Discussions

89 discussions - 157 posts

46 users for March 2011

Content

People

Support

Translate