general@hadoop.apache.org discussions for September 2009

40	HTTP transport?

I'm considering an HTTP-based transport for Avro as the preferred, high-performance option. HTTP has lots of advantages. In particular, it already has - lots of authentication, authorization and ...

Doug Cutting
Sep 11, 2009 at 9:41 pm
Nov 12, 2009 at 10:23 pm

7	HBase configuration...

Hello, I noticed that if I start HBase in "standalone" mode it creates a table in memory. In other words, after rebooting the machine, the table goes away. I would like to persist the table to a ...

Something Something
Sep 30, 2009 at 4:22 pm
Oct 1, 2009 at 8:14 am

6	hadoop scales but is not performant?

hi all, recently i've started playing with hadoop and my first learning experiment has surprised me i'm implementing a a text problem; trying to extract infrequent phrases using a mixture of ...

Mat Kelcey
Sep 15, 2009 at 1:16 am
Sep 16, 2009 at 3:41 am

4	Discussion about Hamburg (provisional name) open sourcing

Hello communities, I'm the one of the Hamburg (provisional name), which is the graph computing framework on Hadoop sponsor. Now we're working on the perfection of our prototype project, and we'll ...

Edward J. Yoon
Sep 14, 2009 at 2:27 am
Sep 18, 2009 at 3:51 am

4	nodes lying idle

Hi everyone, Ive a cluster of 40 nodes. The input file has 2^18 lines and every line is an input to a map job. Every node is a quad core and hence I've set mapred.tasktracker.map/reduce.tasks.maximum ...

Himanshu chandola
Sep 12, 2009 at 5:02 am
Sep 13, 2009 at 4:30 am

4	printing only values and not keys in hadoop output files

Hi Everyone, I'm a new bie to hadoop and had this question. Normally hadoop spits output data in files in the form : key value If i would like it to only write the value and not the key, what do I ...

Himanshu chandola
Sep 5, 2009 at 10:53 pm
Sep 6, 2009 at 7:53 pm

3	multicore node clusters

Hi, I've a cluster where every node is a multicore. From doing internet searches I've figured out that I definitely need to change mapred.tasktracker.tasks.maximum according to the number of ...

Himanshu chandola
Sep 9, 2009 at 5:15 pm
May 5, 2010 at 4:57 am

3	Integrating Lucene in Hadoop

I was doing few R&D on integrating hadoop and Lucene . I could create lucene indexes into HDFS using index contribution provided for Hadoop Is this a proper way to create Lucene index how much it is ...

Chandan Tamrakar
Sep 25, 2009 at 8:14 am
Oct 5, 2009 at 3:49 am

3	Hadoop and Small Files

Hi all, I'm new to Hadoop and currently looking at it for a project where there is around a few TB of data that needs to be stored in a format suitable for MapReduce functions. The problem is that ...

Jonathan Holloway
Sep 14, 2009 at 5:34 pm
Sep 15, 2009 at 5:23 am

2	hadoop hangs on reduce

Hi, Has anyone seen hadoop getting stuck on reduces? I'm using a compiled version of hadoop from cloudera: Hadoop 0.18.3-14.cloudera.CH0_3 Subversion -r HEAD Compiled by root on Mon Jul 6 15:02:31 ...

Himanshu chandola
Sep 17, 2009 at 9:08 pm
Sep 21, 2009 at 10:10 am

2	Problems with hadoop 0.18.0 plugin and Eclipse 3.5 (Galileo)

Hi people! I´m a newbie of Hadoop and I´d like to have an integrated environment for Hadoop and Pig in the same Eclipse Galileo distribution. The Pig plugin (PigPen) works properly but the Hadoop ...

Alberto Luengo Cabanillas
Sep 14, 2009 at 5:07 pm
Sep 14, 2009 at 7:16 pm

1	[Fwd: [VOTE] Avro release 1.1.0 (candidate 1)]

FYI, I have started a new release vote on avro-dev. If you have time, please evaluate the candidate and vote there. Thanks, Doug -------- Original Message -------- Subject: [VOTE] Avro release 1.1.0 ...

Doug Cutting
Sep 8, 2009 at 8:30 pm
Sep 11, 2009 at 5:34 pm

1	drivers to bridge familiar SQL queries to Hadoop MapReduce internals?

I am brand new to Hadoop and have a very newbie question: Is it a Hadoop community priority to build drivers (or layers of drivers) that will help bridge simple, familiar SQL queries to Hadoop ...

Benjamin Cotton
Sep 4, 2009 at 4:17 pm
Sep 4, 2009 at 4:35 pm

1	[Fwd: [Fwd: [VOTE] Release ZooKeeper 3.2.1 (candidate 0)]]

Hadoop PMC, Please test and vote on this release in zookeeper-dev list. Patrick

Patrick Hunt
Sep 3, 2009 at 4:02 am
Sep 3, 2009 at 8:34 pm

0	ArrayList as a column value?

Hello, How do I add values from an ArrayList to a column in a HTable? Let's say I have a "Product" table with columns: name, desc. Now I want to add to each row a list of categories that a product ...

Something Something
Sep 29, 2009 at 10:02 pm
Sep 29, 2009 at 10:02 pm

0	Anubhav Hanjura is out of the office.

Anubhav Hanjura
Sep 28, 2009 at 10:31 pm
Sep 28, 2009 at 10:31 pm

0	ECLIPSE PLUGIN FOR HADOOP 0.20.1

Hi everyone! Does anyone managed to generate the Eclipse plugin JAR file with the latest Hadoop stable version (0.20.1) under Windows? Could anyone help me? Thanks in advance. -- Alberto

Alberto Luengo Cabanillas
Sep 28, 2009 at 2:36 pm
Sep 28, 2009 at 2:36 pm

0	Question about remote execution with Hadoop

Hi everyone! I´m actually working on a project involving Map-Reduce and genetics algorithms (with an iterative approach). I´m developing this project with Eclipse 3.5 (with PigPen and Hadoop 0.18.1 ...

Alberto Luengo Cabanillas
Sep 22, 2009 at 11:22 pm
Sep 22, 2009 at 11:22 pm

0	Question about Eclipse plugin 0.18.0 and latest stable release 0.20.1

Hi all! 20 minutes ago, the latest stable version of Hadoop core has been released, and that made me think about a clean reinstallation of my old Hadoop 0.18.0 core (running in a VMWare image). The ...

Alberto Luengo Cabanillas
Sep 16, 2009 at 6:08 pm
Sep 16, 2009 at 6:08 pm

0	[ANNOUNCE] Hadoop Core 0.20.1 is released

Hadoop Core 0.20.1 has been released and the website is now published. Get them while they are hot! Hadoop 0.20.1 is now considered the stable release and is recommended for new installations. There ...

Owen O'Malley
Sep 16, 2009 at 5:51 pm
Sep 16, 2009 at 5:51 pm

0	Hadoop World: NYC - Speakers and Schedule Up - New: Lightning Talks at Welcome Reception!

Hadoop Fans, we're getting down to the wire for Hadoop World. We couldn't be happier with how the schedule has come together. For a full list of speakers and registration details, see ...

Christophe Bisciglia
Sep 15, 2009 at 9:41 pm
Sep 15, 2009 at 9:41 pm

0	Hadoop and universities/research

I've stuck up a little slideset with some thoughts on what we could be doing to get tighter engagement between universities and the Hadoop codebase ...

Steve Loughran
Sep 15, 2009 at 1:01 pm
Sep 15, 2009 at 1:01 pm

0	Hadoop Map/Reduce and Hive clarification

Hi, I am new to Hadoop , need some clarifications a) how to automate executing Map/Reduce jobs and also automating loading data in Hive, do I need to create a cron job or is there a better way. b) I ...

Deepak Halale
Sep 12, 2009 at 11:28 pm
Sep 12, 2009 at 11:28 pm

0	changing map and reduce model

Hi Ppl, What would Ive to do to make the following model work for the word count application: The input is a text file . What I would like to do is that every map task gets a list of lines equal to ...

Himanshu chandola
Sep 12, 2009 at 3:49 am
Sep 12, 2009 at 3:49 am

0	Hadoop User Group (Bay Area) - Sep 23rd at Yahoo!

Hi all, I'd like to remind everyone that RSVP is open for the next monthly Bay Area Hadoop user group organized by Yahoo!. Agenda and registration available here ...

Dekel Tankel
Sep 11, 2009 at 4:26 pm
Sep 11, 2009 at 4:26 pm

0	Perceus and Hadoop

Has anyone experimented with using the perceus provisioning system and hadoop? I am presently trying to get the hadoop cluster up with this system and I am getting really weird results. sometimes the ...

Gmackey
Sep 9, 2009 at 11:24 pm
Sep 9, 2009 at 11:24 pm

0	[ANN] HBase 0.20.0 available for download

HBase 0.20.0 is available for download: http://hadoop.apache.org/hbase/releases.html The Release Notes are available here: http://su.pr/2sjrkf This HBase is faster, slimmer, sweeter smelling, and ...

Stack
Sep 9, 2009 at 12:09 am
Sep 9, 2009 at 12:09 am

0	Please interpret the output -please help - going mad

Hi I am going mad, pulling my hairs now, past 2 days, trying to figure out the output by this map-reduce program. Please help or you can find me in asylum. in the map function below, ...

Harshit Kumar
Sep 7, 2009 at 10:41 am
Sep 7, 2009 at 10:41 am

0	Type mismatch in value from map: expected org.apache.hadoop.io.Text, recieved org.apache.hadoop.io.IntWritable

I get this error on WordCount program, originally copied from the examples folder in Hadoop-0.19.2. I dont understand why I get this error. Everything is set right. Please see the code and give ...

Harshit Kumar
Sep 7, 2009 at 9:48 am
Sep 7, 2009 at 9:48 am

0	Fwd: MUST READ - we can all use a little luck in our lives...

Good advice! Believe! *This is without a doubt one of the nicest good luck forwards I have received. Hope it works for you -- and me! * *Lotus Touts: You have 6 minutes* *There's some mighty fine ...

Digvijay singh shaktawat
Sep 6, 2009 at 11:05 pm
Sep 6, 2009 at 11:05 pm

0	questions on map and reduce

Hi Everyone, What would be the best way to get map to output values in different formats (reduce needs to add the integer ones) . I realize that writing an ObjectWritable (not of the primitive type ...

Himanshu chandola
Sep 6, 2009 at 7:53 pm
Sep 6, 2009 at 7:53 pm

0	[ANNOUNCE] Apache ZooKeeper 3.2.1

The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.2.1. ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as ...

Patrick Hunt
Sep 5, 2009 at 10:51 pm
Sep 5, 2009 at 10:51 pm

0	[Fwd: [VOTE] Avro release 1.1.0 (candidate 0)]

FYI, I just started a release vote on avro-dev. If you have time, please evaluate the candidate and vote there. Thanks, Doug -------- Original Message -------- Subject: [VOTE] Avro release 1.1.0 ...

Doug Cutting
Sep 4, 2009 at 5:29 pm
Sep 4, 2009 at 5:29 pm

0	hadoop configuration help

Hi, I am trying to configure Hadoop distributed environment . I downloaded hadoop RPM from cloudera, installed it on MACHINE1 (Ubuntu Linux) and MACHINE2 (Fedora Linux) Installed Hadoop RPM on ...

Deepak Halale
Sep 3, 2009 at 2:53 am
Sep 3, 2009 at 2:53 am

0	Hadoop executing a custom WRITABLE type

Hi I am executing a custom writable type called as Duo. It is a class that implement the Writable Interface. input is a text file, in which each record consist of 3 words. for ex: hello come here ...

Harshit Kumar
Sep 2, 2009 at 10:04 pm
Sep 2, 2009 at 10:04 pm

0	[Fwd: [VOTE] Release ZooKeeper 3.2.1 (candidate 0)]

Hadoop PMC, Please test and vote on this release in zookeeper-dev list. Thanks, Patrick

Patrick Hunt
Sep 1, 2009 at 4:47 pm
Sep 1, 2009 at 4:47 pm

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

group	general @
categories	hadoop
discussions	36
posts	89
users	36
website	hadoop.apache.org
irc	#hadoop

Hadoop > general > September 2009

Search Discussions

36 discussions - 89 posts

36 users for September 2009

Content

People

Support

Translate