common-dev@hadoop.apache.org discussions for October 2009

5	What if an XML file cross boundary of HDFS chunks?

Does anybody have the similar issue? If you store XML files in HDFS, how can you make sure a chunk reads by a mapper does not contain partial data of an XML segment? For example: <title <book ...

Steve Gao
Oct 29, 2009 at 8:32 pm
May 17, 2010 at 11:13 am

5	libhdfs with FileSystem cache issue can causes to memory leak ?

Hi All, I'm writing a multi-thread application using libhdfs in C, a known issue of HDFS is that the FileSystem API caches FileSystem handles and always returned the same FileSystem handle when ...

Huy Phan
Oct 13, 2009 at 7:48 am
Oct 13, 2009 at 7:46 pm

4	[VOTE] port HADOOP-6218 (Split TFile by Record Sequence Number) to hadoop 0.20/0.21

HADOOP-6218 exposed the internal "Location" object as a global Record Sequence Number (RecNum). The feature is useful in a number of ways: (1) support progress reporting for upper layers (object ...

Hong Tang
Oct 12, 2009 at 10:56 pm
Oct 16, 2009 at 10:00 pm

2	[jira] Created: (HADOOP-6325) need security keys storage solution

need security keys storage solution ----------------------------------- Key: HADOOP-6325 URL: https://issues.apache.org/jira/browse/HADOOP-6325 Project: Hadoop Common Issue Type: New Feature ...

Boris Shkolnik (JIRA)
Oct 20, 2009 at 7:57 pm
Nov 24, 2009 at 9:34 pm

2	[jira] Created: (HADOOP-6339) SequenceFile writer does not properly flush stream with external DataOutputStream

SequenceFile writer does not properly flush stream with external DataOutputStream --------------------------------------------------------------------------------- Key: HADOOP-6339 URL: ...

Jonathan Hsieh (JIRA)
Oct 28, 2009 at 12:24 am
Oct 29, 2009 at 12:49 am

2	How to develop webapps of hadoop?

Dear friends: I'm a student of the Bjtu university in China. I have learned Hadoop for some days. I find that the webapps of Hadoop, such as hdfs webapps(http://localhost:50070), are not easy to use ...

Vsmingren
Oct 22, 2009 at 10:08 am
Oct 22, 2009 at 2:22 pm

2	Problem reading HDFS block size > 1GB

Hi all, We are running Yahoo distribution of Hadoop based on Hadoop 0.20.0-2787265 . On a 10 nodes cluster with OpenSUSE Linux Operating System. We have HDFS configured with Block Size 5GB (This is ...

Vinay Setty
Oct 1, 2009 at 11:32 am
Oct 2, 2009 at 3:35 pm

1	[jira] Created: (HADOOP-6335) Support reading of concatenated gzip files

Support reading of concatenated gzip files ------------------------------------------ Key: HADOOP-6335 URL: https://issues.apache.org/jira/browse/HADOOP-6335 Project: Hadoop Common Issue Type: ...

Ravi Gummadi (JIRA)
Oct 27, 2009 at 1:03 pm
May 26, 2010 at 7:02 am

1	[jira] Created: (HADOOP-6328) Hadoop 0.20 Docs - backport changes for streaming and m/r tutorial docs

Hadoop 0.20 Docs - backport changes for streaming and m/r tutorial docs ----------------------------------------------------------------------- Key: HADOOP-6328 URL: ...

Corinne Chandel (JIRA)
Oct 22, 2009 at 5:55 pm
Feb 19, 2010 at 7:07 am

1	[jira] Created: (HADOOP-6348) ant test command should not pick up hadoop-site.xml from conf directory

ant test command should not pick up hadoop-site.xml from conf directory ------------------------------------------------------------------------ Key: HADOOP-6348 URL: ...

Amareshwari Sriramadasu (JIRA)
Oct 30, 2009 at 6:44 am
Jan 29, 2010 at 9:40 am

1	[jira] Created: (HADOOP-6301) Need to post Injection HowTo to Apache Hadoop's Wiki

Need to post Injection HowTo to Apache Hadoop's Wiki ----------------------------------------------------- Key: HADOOP-6301 URL: https://issues.apache.org/jira/browse/HADOOP-6301 Project: Hadoop ...

Konstantin Boudnik (JIRA)
Oct 8, 2009 at 5:22 pm
Nov 13, 2009 at 11:22 pm

1	A question about the hadoop examples

Hi,everyone! I just have a question about the example which compute the pi using monte-karo method. Why when i run it i must use "pi" for the class name rather than use "PiEstimator" ??? Thanks very ...

Superxgl
Oct 30, 2009 at 12:43 pm
Oct 30, 2009 at 3:30 pm

1	[jira] Created: (HADOOP-6333) Generic options parser eats up IOException during parsing of -files, -libjars and -archives

Generic options parser eats up IOException during parsing of -files, -libjars and -archives -------------------------------------------------------------------------------------------- Key: ...

Amareshwari Sriramadasu (JIRA)
Oct 26, 2009 at 9:27 am
Oct 27, 2009 at 4:40 am

1	[jira] Created: (HADOOP-6331) Upload Hadoop core jars to a public maven repository

Upload Hadoop core jars to a public maven repository ---------------------------------------------------- Key: HADOOP-6331 URL: https://issues.apache.org/jira/browse/HADOOP-6331 Project: Hadoop ...

Cyril Lakech (JIRA)
Oct 24, 2009 at 9:14 pm
Oct 26, 2009 at 12:33 pm

1	[jira] Created: (HADOOP-6326) Hundson runs should check for AspectJ warnings and report failure if any is present

Hundson runs should check for AspectJ warnings and report failure if any is present ----------------------------------------------------------------------------------- Key: HADOOP-6326 URL: ...

Konstantin Boudnik (JIRA)
Oct 21, 2009 at 9:13 pm
Oct 23, 2009 at 10:36 pm

1	[jira] Created: (HADOOP-6329) Add build-fi directory to the ignore list

Add build-fi directory to the ignore list ----------------------------------------- Key: HADOOP-6329 URL: https://issues.apache.org/jira/browse/HADOOP-6329 Project: Hadoop Common Issue Type: Task ...

Tsz Wo (Nicholas), SZE (JIRA)
Oct 23, 2009 at 5:51 pm
Oct 23, 2009 at 6:28 pm

1	[jira] Created: (HADOOP-6305) Unify build property names to facilitate cross-projects modifications

Unify build property names to facilitate cross-projects modifications --------------------------------------------------------------------- Key: HADOOP-6305 URL: ...

Konstantin Boudnik (JIRA)
Oct 9, 2009 at 6:53 pm
Oct 10, 2009 at 1:13 am

1	[jira] Created: (HADOOP-6303) Eclipse .classpath template has outdated jar files and is missing some new ones.

Eclipse .classpath template has outdated jar files and is missing some new ones. -------------------------------------------------------------------------------- Key: HADOOP-6303 URL: ...

Konstantin Boudnik (JIRA)
Oct 8, 2009 at 8:11 pm
Oct 8, 2009 at 11:10 pm

1	MapReduce with Hypertable using Python

Hi all, I'm looking for a way to use MapReduce with Hypertable using Hadoop Streaming. How can I pass Hypertable data to the MapReduce framework using Python as HadoopStreaming only supports text ...

Sreejith K
Oct 7, 2009 at 4:16 pm
Oct 7, 2009 at 10:19 pm

1	Hey Cloudera can you help us In beating Google Yahoo Facebook?

Hey Cloudera genius guys . I read this Via Cloudera, Hadoop is currently used by most of the giants in the space including Google, Yahoo, Facebook (we wrote about Facebook’s use of Cloudera here), ...

Smith Stan
Oct 2, 2009 at 11:03 pm
Oct 2, 2009 at 11:37 pm

0	[jira] Created: (HADOOP-6351) CSV Grammer should have } as disallowed in buffer

CSV Grammer should have } as disallowed in buffer ------------------------------------------------- Key: HADOOP-6351 URL: https://issues.apache.org/jira/browse/HADOOP-6351 Project: Hadoop Common ...

Paul Tarjan (JIRA)
Oct 31, 2009 at 10:48 am
Oct 31, 2009 at 10:48 am

0	Http 404 Error while viewing tasktracker in Browser

Hi all, I have downloaded hadoop and configured it in my local system.I have run the wordcount program with some files as dataset .It run successfully but when I opened the browser to see GUI for ...

Abhilaash
Oct 31, 2009 at 10:31 am
Oct 31, 2009 at 10:31 am

0	[jira] Created: (HADOOP-6350) We should have some mechanism to enforce metrics as part of the public API.

We should have some mechanism to enforce metrics as part of the public API. --------------------------------------------------------------------------- Key: HADOOP-6350 URL: ...

Hong Tang (JIRA)
Oct 31, 2009 at 1:01 am
Oct 31, 2009 at 1:01 am

0	[jira] Created: (HADOOP-6349) Implement FastLZCodec for fastlz/lzo algorithm

Implement FastLZCodec for fastlz/lzo algorithm ---------------------------------------------- Key: HADOOP-6349 URL: https://issues.apache.org/jira/browse/HADOOP-6349 Project: Hadoop Common Issue ...

William Kinney (JIRA)
Oct 30, 2009 at 10:24 pm
Oct 30, 2009 at 10:24 pm

0	[jira] Created: (HADOOP-6347) run-test-core-fault-inject runs a test case twice if -Dtestcase is set

run-test-core-fault-inject runs a test case twice if -Dtestcase is set ---------------------------------------------------------------------- Key: HADOOP-6347 URL: ...

Konstantin Boudnik (JIRA)
Oct 30, 2009 at 4:37 am
Oct 30, 2009 at 4:37 am

0	[jira] Created: (HADOOP-6346) Move RunJar from common and add support for regexes to Configuration

Move RunJar from common and add support for regexes to Configuration -------------------------------------------------------------------- Key: HADOOP-6346 URL: ...

Todd Lipcon (JIRA)
Oct 29, 2009 at 11:00 pm
Oct 29, 2009 at 11:00 pm

0	[jira] Created: (HADOOP-6345) Refactor Trash::moveToTrash() and its accompanying poor tests

Refactor Trash::moveToTrash() and its accompanying poor tests ------------------------------------------------------------- Key: HADOOP-6345 URL: https://issues.apache.org/jira/browse/HADOOP-6345 ...

Jakob Homan (JIRA)
Oct 29, 2009 at 10:50 pm
Oct 29, 2009 at 10:50 pm

0	[jira] Created: (HADOOP-6343) Stack trace of any runtime exceptions should be recorded in the server logs.

Stack trace of any runtime exceptions should be recorded in the server logs. ----------------------------------------------------------------------------- Key: HADOOP-6343 URL: ...

Jitendra Nath Pandey (JIRA)
Oct 29, 2009 at 8:40 pm
Oct 29, 2009 at 8:40 pm

0	ReducerTask OOM failure

Hi, After moving to Cloudera 0.20.1 release and upgrade to 64GB machines, started facing occasional OOMs with higher number of reducers when reducers started copying map outputs. ...

Sanjay Sharma
Oct 29, 2009 at 5:08 pm
Oct 29, 2009 at 5:08 pm

0	[jira] Created: (HADOOP-6342) Create a script to squash a common, hdfs, and mapreduce tarball into a single hadoop tarball

Create a script to squash a common, hdfs, and mapreduce tarball into a single hadoop tarball -------------------------------------------------------------------------------------------- Key: ...

Owen O'Malley (JIRA)
Oct 29, 2009 at 4:35 pm
Oct 29, 2009 at 4:35 pm

0	[jira] Created: (HADOOP-6341) Hudson giving a +1 though no tests are included.

Hudson giving a +1 though no tests are included. ------------------------------------------------ Key: HADOOP-6341 URL: https://issues.apache.org/jira/browse/HADOOP-6341 Project: Hadoop Common Issue ...

Hemanth Yamijala (JIRA)
Oct 29, 2009 at 3:43 am
Oct 29, 2009 at 3:43 am

0	[jira] Resolved: (HADOOP-3474) Need an option -rm and -rmr to not move to Trash, but actually delete

[ https://issues.apache.org/jira/browse/HADOOP-3474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HADOOP-3474. --------------------------------- Resolution: ...

Jakob Homan (JIRA)
Oct 28, 2009 at 11:04 pm
Oct 28, 2009 at 11:04 pm

0	[jira] Created: (HADOOP-6340) Change build/test/clean targets to prevent tar target from including clover instrumented code

Change build/test/clean targets to prevent tar target from including clover instrumented code --------------------------------------------------------------------------------------------- Key: ...

Lee Tucker (JIRA)
Oct 28, 2009 at 3:42 pm
Oct 28, 2009 at 3:42 pm

0	[jira] Created: (HADOOP-6338) Utility to tail the contents of a directory

Utility to tail the contents of a directory ------------------------------------------- Key: HADOOP-6338 URL: https://issues.apache.org/jira/browse/HADOOP-6338 Project: Hadoop Common Issue Type: ...

dhruba borthakur (JIRA)
Oct 28, 2009 at 12:19 am
Oct 28, 2009 at 12:19 am

0	[jira] Created: (HADOOP-6337) Update FilterInitializer class to be more visible and take a conf for further development

Update FilterInitializer class to be more visible and take a conf for further development ----------------------------------------------------------------------------------------- Key: HADOOP-6337 ...

Jakob Homan (JIRA)
Oct 27, 2009 at 10:49 pm
Oct 27, 2009 at 10:49 pm

0	[jira] Created: (HADOOP-6336) Update Map/Reduce Tutorial to use the classes Job and Configuration instead of JobConf

Update Map/Reduce Tutorial to use the classes Job and Configuration instead of JobConf -------------------------------------------------------------------------------------- Key: HADOOP-6336 URL: ...

Oliver B. Fischer (JIRA)
Oct 27, 2009 at 1:43 pm
Oct 27, 2009 at 1:43 pm

0	[jira] Created: (HADOOP-6334) GenericOptionsParser does not understand uri for -files -libjars and -archives option

GenericOptionsParser does not understand uri for -files -libjars and -archives option ------------------------------------------------------------------------------------- Key: HADOOP-6334 URL: ...

Amareshwari Sriramadasu (JIRA)
Oct 26, 2009 at 11:51 am
Oct 26, 2009 at 11:51 am

0	[jira] Created: (HADOOP-6332) Large-scale Automated Test Framework

Large-scale Automated Test Framework ------------------------------------ Key: HADOOP-6332 URL: https://issues.apache.org/jira/browse/HADOOP-6332 Project: Hadoop Common Issue Type: New Feature ...

Arun C Murthy (JIRA)
Oct 25, 2009 at 6:30 am
Oct 25, 2009 at 6:30 am

0	[jira] Created: (HADOOP-6330) Integrating IBM General Parallel File System implementation of Hadoop Filesystem interface

Integrating IBM General Parallel File System implementation of Hadoop Filesystem interface ------------------------------------------------------------------------------------------ Key: HADOOP-6330 ...

Reshu Jain (JIRA)
Oct 23, 2009 at 10:36 pm
Oct 23, 2009 at 10:36 pm

0	HADOOP-6318: upgrade to Avro 1.2.0

Can another committer please review this issue? https://issues.apache.org/jira/browse/HADOOP-6318 Thanks, Doug

Doug Cutting
Oct 22, 2009 at 8:45 pm
Oct 22, 2009 at 8:45 pm

0	[jira] Created: (HADOOP-6327) Fix build error for one of the FileContext errors

Fix build error for one of the FileContext errors ------------------------------------------------- Key: HADOOP-6327 URL: https://issues.apache.org/jira/browse/HADOOP-6327 Project: Hadoop Common ...

Sanjay Radia (JIRA)
Oct 22, 2009 at 7:39 am
Oct 22, 2009 at 7:39 am

0	hdfs jclouds extension

Hi, hadoopers. I'm finalizing the asynchronous interface jclouds presents as an abstraction across cloud storage providers this week. This offers portability across S3, Azure, Rackspace, Mezeo, Atmos ...

Adrian Cole
Oct 21, 2009 at 9:56 pm
Oct 21, 2009 at 9:56 pm

0	[jira] Created: (HADOOP-6324) FileSystem API should allow progress callbacks in rename and delete

FileSystem API should allow progress callbacks in rename and delete ------------------------------------------------------------------- Key: HADOOP-6324 URL: ...

Aaron Kimball (JIRA)
Oct 20, 2009 at 6:02 pm
Oct 20, 2009 at 6:02 pm

0	[jira] Created: (HADOOP-6323) Serialization should provide comparators

Serialization should provide comparators ---------------------------------------- Key: HADOOP-6323 URL: https://issues.apache.org/jira/browse/HADOOP-6323 Project: Hadoop Common Issue Type: New ...

Doug Cutting (JIRA)
Oct 20, 2009 at 5:06 pm
Oct 20, 2009 at 5:06 pm

0	[jira] Resolved: (HADOOP-3835) Develop scripts to create rpm package to facilitate deployment of hadoop on Linux machines

[ https://issues.apache.org/jira/browse/HADOOP-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-3835. ------------------------------------ ...

Steve Loughran (JIRA)
Oct 20, 2009 at 4:16 pm
Oct 20, 2009 at 4:16 pm

0	[jira] Created: (HADOOP-6321) Hadoop Common - Site logo

Hadoop Common - Site logo ------------------------- Key: HADOOP-6321 URL: https://issues.apache.org/jira/browse/HADOOP-6321 Project: Hadoop Common Issue Type: Task Components: documentation Reporter: ...

Corinne Chandel (JIRA)
Oct 19, 2009 at 7:38 pm
Oct 19, 2009 at 7:38 pm

0	[jira] Created: (HADOOP-6320) Hadoop EC2 terminate-instances should terminate only those instances listed in the confirmation listing

Hadoop EC2 terminate-instances should terminate only those instances listed in the confirmation listing ...

Tom White (JIRA)
Oct 19, 2009 at 4:54 pm
Oct 19, 2009 at 4:54 pm

0	[jira] Created: (HADOOP-6319) Capacity reporting incorrect on Solaris

Capacity reporting incorrect on Solaris --------------------------------------- Key: HADOOP-6319 URL: https://issues.apache.org/jira/browse/HADOOP-6319 Project: Hadoop Common Issue Type: Bug ...

Doug Judd (JIRA)
Oct 18, 2009 at 5:42 pm
Oct 18, 2009 at 5:42 pm

0	State Transition problem

Hi, I am using Hadoop 0.20.1 and I have a problem which is similar to the one below: Setup ----- I have a web server log that looks like: The web server outputs to a single log file for 1,000 ...

Shahfik Bin AMASHA
Oct 18, 2009 at 11:59 am
Oct 18, 2009 at 11:59 am

0	[jira] Created: (HADOOP-6318) Upgrade to Avro 1.2.0

Upgrade to Avro 1.2.0 --------------------- Key: HADOOP-6318 URL: https://issues.apache.org/jira/browse/HADOOP-6318 Project: Hadoop Common Issue Type: Improvement Components: io, ipc Reporter: Doug ...

Doug Cutting (JIRA)
Oct 16, 2009 at 9:46 pm
Oct 16, 2009 at 9:46 pm

group	common-dev @
categories	hadoop
discussions	79
posts	111
users	32
website	hadoop.apache.org...
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > common-dev > October 2009

Search Discussions

79 discussions - 111 posts

32 users for October 2009

Content

People

Support

Translate