common-dev@hadoop.apache.org discussions for December 2010

5	FileSystem and Fs APIs

I noticed that in HDFS there are two sets of API classes - *FileSystem and *FS, e.g. FtpFileSystem vs. FtpFs, ChecksumFileSystem vs. ChecksumFS. I wonder what is the difference. One is replacement of ...

Zhenhua Guo
Dec 31, 2010 at 4:16 am
Jan 2, 2011 at 10:43 pm

4	What is the correct spelling?

Hi, I noticed that the isSplitable method (and a bunch of other places in the Hadoop codebase) writes "splitable" where I would have expected "splittable" (two 't' instead of one). All spelling ...

Niels Basjes
Dec 25, 2010 at 9:30 pm
Dec 27, 2010 at 8:42 pm

4	FileInputFormat.setInputPaths Problem

Dear all, I would very much appreciate your advise on this problem [I am using Hadoop 20.0]: I need to know how to pass the input folder path to the java class throught the function( ...

Rawan AlSaad
Dec 4, 2010 at 2:28 pm
Dec 10, 2010 at 12:42 am

3	[jira] Created: (HADOOP-7060) A more elegant FileSystem#listCorruptFileBlocks API

A more elegant FileSystem#listCorruptFileBlocks API --------------------------------------------------- Key: HADOOP-7060 URL: https://issues.apache.org/jira/browse/HADOOP-7060 Project: Hadoop Common ...

Hairong Kuang (JIRA)
Dec 8, 2010 at 11:20 pm
Dec 16, 2010 at 11:30 pm

3	CDH3b3 deadlock in jobtracker

We have upgraded from CDH3b2 to CDH3b3 recently, and our job tracker process now consistently deadlocks when running a particular map reduce job that worked with the previous version. Here is a ...

Luke Forehand
Dec 16, 2010 at 5:05 pm
Dec 16, 2010 at 6:00 pm

3	Process ID and Hadoop job ID

Hi, I want to know if there is any way to find out the process id (PID) of a task running on a TaskTracker corresponding to a particular Hadoop job ID. All the Hadoop tasks are launched as java ...

Radheshyam nanduri
Dec 8, 2010 at 9:48 am
Dec 8, 2010 at 4:20 pm

2	setting "mapred.task.cache.levels" to 0 makes Hadoop stall

It seems that mapred.task.cache.levels is used by JobTracker to create task caches for nodes at various levels. This makes data-locality scheduling possible. If I set mapred.task.cache.levels to 0 ...

Zhenhua Guo
Dec 20, 2010 at 11:28 pm
Apr 1, 2011 at 9:00 pm

2	Review Request: Add copyBytes method to Text and BytesWritable to improve usability

----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/182/ ...

Owen O'Malley
Dec 16, 2010 at 1:31 pm
Dec 17, 2010 at 1:36 am

2	Hadoop-Common-22-branch - Build # 5 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Common-22-branch/5/ ################################################################################### ########################## LAST 60 LINES OF THE ...

Apache Hudson Server
Dec 1, 2010 at 9:53 am
Dec 16, 2010 at 9:32 pm

1	[jira] Created: (HADOOP-7069) Replace forrest with supported framework

Replace forrest with supported framework ---------------------------------------- Key: HADOOP-7069 URL: https://issues.apache.org/jira/browse/HADOOP-7069 Project: Hadoop Common Issue Type: ...

Jakob Homan (JIRA)
Dec 20, 2010 at 1:16 am
May 21, 2012 at 7:49 pm

1	[jira] Created: (HADOOP-7063) ChecksumFileSystem should implement flush()

ChecksumFileSystem should implement flush() ------------------------------------------- Key: HADOOP-7063 URL: https://issues.apache.org/jira/browse/HADOOP-7063 Project: Hadoop Common Issue Type: ...

Kang Xiao (JIRA)
Dec 15, 2010 at 3:51 am
Nov 21, 2011 at 8:25 pm

1	[jira] Created: (HADOOP-7071) test-patch.sh has bad ps arg

test-patch.sh has bad ps arg ---------------------------- Key: HADOOP-7071 URL: https://issues.apache.org/jira/browse/HADOOP-7071 Project: Hadoop Common Issue Type: Bug Components: build Reporter: ...

Nigel Daley (JIRA)
Dec 21, 2010 at 9:30 pm
Dec 21, 2010 at 9:30 pm

1	Questions on HADOOP-6713

Hi all, After apply the patch from HADOOP-6713 into our hadoop source tree, I did a benchmark on multi-readers RPC, and didn't found any throughput improvement . The attachment of this mail is a ...

Min Zhou
Dec 17, 2010 at 4:45 am
Dec 20, 2010 at 1:28 am

1	Developing Hadoop in Eclipse

Hi, I want to implement a new scheduling algorithm for Hadoop. So far I could install and work with SVN hadoop repository in Eclipse. As I know, in the new version of hadoop (0.21.0), it is possible ...

A. Rasoolioskooei
Dec 13, 2010 at 7:39 pm
Dec 14, 2010 at 4:15 am

1	Granting contributor status

Hello all, A colleague of mine is doing some work on a patch while I am unavailable to work on it, so I'd like to assign the JIRA item to him. To whom do I address requests to make him a Contributor ...

Alex‎ Nelson
Dec 6, 2010 at 5:51 pm
Dec 6, 2010 at 5:56 pm

1	Explicit Data Placement

Dear all, I understand that specifying data placement may not be in the spirit of Hadoop, however I would like to explicitly locate data input on various nodes to assert the value of data locality ...

Yipeng
Dec 6, 2010 at 3:30 pm
Dec 6, 2010 at 3:53 pm

1	Native code and autoconf generated files

Hi, This question pertains to the 0.21 release. When adding code to the Hadoop native code library what is the preferred method for regenerating Makefile.in? I've tried to use autoreconf, but it ...

Noah Watkins
Dec 4, 2010 at 11:44 pm
Dec 5, 2010 at 1:41 am

0	[jira] Created: (HADOOP-7080) Documentation dfs.block.size where dfs.blocksize has to be used instead.

Documentation dfs.block.size where dfs.blocksize has to be used instead. ------------------------------------------------------------------------ Key: HADOOP-7080 URL: ...

Karl Heinz Marbaise (JIRA)
Dec 29, 2010 at 6:36 pm
Dec 29, 2010 at 6:36 pm

0	[jira] Created: (HADOOP-7079) Refactor IPC proxy creation to use Builder pattern

Refactor IPC proxy creation to use Builder pattern -------------------------------------------------- Key: HADOOP-7079 URL: https://issues.apache.org/jira/browse/HADOOP-7079 Project: Hadoop Common ...

Todd Lipcon (JIRA)
Dec 28, 2010 at 12:35 am
Dec 28, 2010 at 12:35 am

0	[jira] Created: (HADOOP-7077) Use Java's ServiceLoader to add default resources to Configuration

Use Java's ServiceLoader to add default resources to Configuration ------------------------------------------------------------------ Key: HADOOP-7077 URL: ...

Tom White (JIRA)
Dec 23, 2010 at 5:43 pm
Dec 23, 2010 at 5:43 pm

0	[jira] Created: (HADOOP-7076) Splittable Gzip

Splittable Gzip --------------- Key: HADOOP-7076 URL: https://issues.apache.org/jira/browse/HADOOP-7076 Project: Hadoop Common Issue Type: New Feature Components: io Reporter: Niels Basjes Files ...

Niels Basjes (JIRA)
Dec 23, 2010 at 10:11 am
Dec 23, 2010 at 10:11 am

0	[jira] Created: (HADOOP-7075) Make the 'docs' target work with JDK6

Make the 'docs' target work with JDK6 ------------------------------------- Key: HADOOP-7075 URL: https://issues.apache.org/jira/browse/HADOOP-7075 Project: Hadoop Common Issue Type: Bug Components: ...

Carl Steinbach (JIRA)
Dec 23, 2010 at 7:40 am
Dec 23, 2010 at 7:40 am

0	[jira] Resolved: (HADOOP-3302) Support Maven-based builds

[ https://issues.apache.org/jira/browse/HADOOP-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-3302. --------------------------------- Resolution: ...

Eli Collins (JIRA)
Dec 22, 2010 at 6:49 pm
Dec 22, 2010 at 6:49 pm

0	[jira] Created: (HADOOP-7073) Remove java5 dependencies from build

Remove java5 dependencies from build ------------------------------------ Key: HADOOP-7073 URL: https://issues.apache.org/jira/browse/HADOOP-7073 Project: Hadoop Common Issue Type: Sub-task ...

Konstantin Boudnik (JIRA)
Dec 22, 2010 at 5:20 am
Dec 22, 2010 at 5:20 am

0	[jira] Created: (HADOOP-7074) Remove java5 dependencies from build

Remove java5 dependencies from build ------------------------------------ Key: HADOOP-7074 URL: https://issues.apache.org/jira/browse/HADOOP-7074 Project: Hadoop Common Issue Type: Sub-task ...

Konstantin Boudnik (JIRA)
Dec 22, 2010 at 5:20 am
Dec 22, 2010 at 5:20 am

0	[jira] Created: (HADOOP-7072) Remove java5 dependencies from build

Remove java5 dependencies from build ------------------------------------ Key: HADOOP-7072 URL: https://issues.apache.org/jira/browse/HADOOP-7072 Project: Hadoop Common Issue Type: Sub-task ...

Konstantin Boudnik (JIRA)
Dec 22, 2010 at 2:46 am
Dec 22, 2010 at 2:46 am

0	[jira] Created: (HADOOP-7070) JAAS configuration should delegate unknown application names to pre-existing configuration

JAAS configuration should delegate unknown application names to pre-existing configuration ------------------------------------------------------------------------------------------ Key: HADOOP-7070 ...

Todd Lipcon (JIRA)
Dec 20, 2010 at 11:19 pm
Dec 20, 2010 at 11:19 pm

0	[jira] Created: (HADOOP-7068) Ivy resolve force mode should be turned off by default

Ivy resolve force mode should be turned off by default ------------------------------------------------------ Key: HADOOP-7068 URL: https://issues.apache.org/jira/browse/HADOOP-7068 Project: Hadoop ...

Luke Lu (JIRA)
Dec 17, 2010 at 9:56 pm
Dec 17, 2010 at 9:56 pm

0	[jira] Created: (HADOOP-7067) Remove fault injection artifacts from the default build and push to maven for Map-Reduce

Remove fault injection artifacts from the default build and push to maven for Map-Reduce ---------------------------------------------------------------------------------------- Key: HADOOP-7067 URL: ...

Arun C Murthy (JIRA)
Dec 17, 2010 at 6:44 pm
Dec 17, 2010 at 6:44 pm

0	[jira] Created: (HADOOP-7066) Remove fault injection artifacts from the default build and push to maven for HDFS

Remove fault injection artifacts from the default build and push to maven for HDFS ---------------------------------------------------------------------------------- Key: HADOOP-7066 URL: ...

Arun C Murthy (JIRA)
Dec 17, 2010 at 6:44 pm
Dec 17, 2010 at 6:44 pm

0	[jira] Created: (HADOOP-7065) jobhistory.jsp cuts off the job name at the first underscore of the job name

jobhistory.jsp cuts off the job name at the first underscore of the job name ---------------------------------------------------------------------------- Key: HADOOP-7065 URL: ...

Bill Au (JIRA)
Dec 16, 2010 at 9:42 pm
Dec 16, 2010 at 9:42 pm

0	Hadoop File system performance counters

Hi, What do the following two File Sytem counters associated with a job (and printed at the end of a job's execution) represent? FILE_BYTES_READ and FILE_BYTES_WRITTEN How are they different from the ...

Abhishek sharma
Dec 15, 2010 at 5:38 pm
Dec 15, 2010 at 5:38 pm

0	Regarding Hadoop Decommission Process [Is there any mechanism to speedup this activity]

Hi , Hadoop decommission will happen in background ,But it will not utilize the whole memory as a result of this decommission will happen slowly, Now my concern :Is there anyway of speeding up this ...

Sandeep
Dec 14, 2010 at 6:00 pm
Dec 14, 2010 at 6:00 pm

0	Failing to compile hadoop-common (trunk or 0.21)

Hello Everyone, I am new to Hadoop. I have been able to install it successfully. As a next step I have been trying to build the hadoop common from eclipse but running into some compile errors. Here ...

Vivek Garg
Dec 14, 2010 at 6:05 am
Dec 14, 2010 at 6:05 am

0	[jira] Created: (HADOOP-7062) Single Noe Setup example command line error

Single Noe Setup example command line error ------------------------------------------- Key: HADOOP-7062 URL: https://issues.apache.org/jira/browse/HADOOP-7062 Project: Hadoop Common Issue Type: ...

Chet Wang (JIRA)
Dec 14, 2010 at 3:12 am
Dec 14, 2010 at 3:12 am

0	Hadoop-Common-trunk-Commit - Build # 453 - Failure

See https://hudson.apache.org/hudson/job/Hadoop-Common-trunk-Commit/453/ ################################################################################### ########################## LAST 60 LINES ...

Apache Hudson Server
Dec 9, 2010 at 10:35 pm
Dec 9, 2010 at 10:35 pm

0	[jira] Created: (HADOOP-7061) unprecise javadoc for CompressionCodec

unprecise javadoc for CompressionCodec -------------------------------------- Key: HADOOP-7061 URL: https://issues.apache.org/jira/browse/HADOOP-7061 Project: Hadoop Common Issue Type: Improvement ...

Jingguo Yao (JIRA)
Dec 9, 2010 at 1:33 pm
Dec 9, 2010 at 1:33 pm

0	Overloading file URI scheme

Hello all, We are looking for some expertise with Hadoop's handling of URI schemes. Our problem is that we want to subclass RawLocalFileSystem for the Ceph file system [1], and get all of RawLocal's ...

Alex‎ Nelson
Dec 8, 2010 at 12:10 am
Dec 8, 2010 at 12:10 am

0	[jira] Created: (HADOOP-7059) Remove "unused" warning in native code

Remove "unused" warning in native code -------------------------------------- Key: HADOOP-7059 URL: https://issues.apache.org/jira/browse/HADOOP-7059 Project: Hadoop Common Issue Type: Improvement ...

Noah Watkins (JIRA)
Dec 7, 2010 at 9:51 pm
Dec 7, 2010 at 9:51 pm

0	[jira] Created: (HADOOP-7058) Expose number of bytes in FSOutputSummer buffer to implementatins

Expose number of bytes in FSOutputSummer buffer to implementatins ----------------------------------------------------------------- Key: HADOOP-7058 URL: ...

Todd Lipcon (JIRA)
Dec 7, 2010 at 3:53 am
Dec 7, 2010 at 3:53 am

0	[jira] Resolved: (HADOOP-2663) Buffer class' toString method should accept a code name for "true" utf-8 codeName

[ https://issues.apache.org/jira/browse/HADOOP-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar resolved HADOOP-2663. --------------------------------------- ...

Milind Bhandarkar (JIRA)
Dec 7, 2010 at 12:46 am
Dec 7, 2010 at 12:46 am

0	hadoop.tmp.dir

On a production cluster, is it acceptable to have the following properties set to subfolders of hadoop.tmp.dir? (hadoop.tmp.dir=/tmp/hadoop-hadoop) fs.checkpoint.dir mapred.local.dir mapred.temp.dir ...

Dave Shine
Dec 1, 2010 at 8:58 pm
Dec 1, 2010 at 8:58 pm

0	[jira] Created: (HADOOP-7057) IOUtils.readFully has typo in exception creation's message

IOUtils.readFully has typo in exception creation's message ---------------------------------------------------------- Key: HADOOP-7057 URL: https://issues.apache.org/jira/browse/HADOOP-7057 Project: ...

Konstantin Boudnik (JIRA)
Dec 1, 2010 at 1:01 am
Dec 1, 2010 at 1:01 am

group	common-dev @
categories	hadoop
discussions	43
posts	76
users	34
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > common-dev > December 2010

Search Discussions

43 discussions - 76 posts

34 users for December 2010

Content

People

Support

Translate