November 2006

Discussions Analytics Info

Search Discussions

25 discussions - 115 posts

Newest Active Popular

15
Help in setting Hadoop on multiple servers

Hi Currently I have 3 servers, A, B, C 1. I unpacked Hadoop separately on three machines on the same folder (local): /home/hadoop/ 2. I follow the documentation, set up the JAVA_HOME path, and ...

Howard chen
Nov 4, 2006 at 2:15 pm
Nov 10, 2006 at 4:10 am
11
Some queries on Master node

Hi, I have a cluster of more than 25 servers which basically serves the purpose for storage. However I was wondering what will happen if the master node gets exhausted of disk space. If I add more ...

Jagadeesh
Nov 1, 2006 at 4:01 pm
Nov 10, 2006 at 11:52 am
10
MapFile.get() has a bug?

Hi all, For example, I have a MapFile, which is like: K - V 1 - 1 1 - 2 1 - 3 2 - 1 2 - 2 2 - 3 3 - 1 3 - 2 3 - 3 when i call mapFile.get(2, value), the value will be filled as 2, not 1. Is is a bug ...

Feng Jiang
Nov 28, 2006 at 6:16 am
Nov 29, 2006 at 3:39 am
9
Deleting things in the DFS

Hi, I was just wondering how DFS frees up disk space. Whenever I delete something, I notice that disk space isn't freed up immediately. If I restart the DFS, it's freed immediately on startup. Is ...

Vetle Roeim
Nov 13, 2006 at 3:50 pm
Nov 15, 2006 at 9:38 pm
7
Some new requests about mapreduce

I think some features are very useful for us: 1. Multi-key types supported in input. for example: SEQ file A is <Ka, Va pair, and SEQ file B is <Kb, Vb pair. I can simply add both of these files as ...

Feng Jiang
Nov 4, 2006 at 5:57 am
Dec 20, 2006 at 5:01 pm
6
some newby questions

Howdy, Is there a way to store "by-product" data someplace where it can be read? For example, as I'm iterating over a collection of documents, I want to generate some statistics about the collection, ...

David Pollak
Nov 8, 2006 at 12:04 am
Nov 8, 2006 at 11:19 pm
4
configuration question

Hi: After startind HDFS, I am able to create directories via the Hadoop api and the shell app. However I am not able to create a new file: I keep on getting problems connecting to the data node. (on ...

John Wang
Nov 24, 2006 at 2:11 am
Nov 28, 2006 at 3:01 pm
4
lucene index on hadoop

Does it make sense to build large lucene indexes onto the Hadopp DFS? I would think there would be some performance concerns? Did anyone have experiences with this? Thanks -John

John Wang
Nov 18, 2006 at 11:42 pm
Nov 20, 2006 at 11:51 pm
4
Race Condition with Renewing Leases and RPC Calls

This is going to be a long email. I am seeing a race condition between the renewing of leases on the DFS and RPC client timeout values and I wanted to get some feedback on this. We keep seeing leases ...

Dennis Kubes
Nov 1, 2006 at 8:02 pm
Nov 1, 2006 at 10:15 pm
3
How to use MapFile?

Hi all: Now I want to do some operations like ‘update’ or ‘insert’, which can describe like this: 1. I have a base dataset 2. Everyday I will get more data from other places, and then I want to ...

张茂森
Nov 13, 2006 at 3:08 am
Nov 13, 2006 at 6:59 pm
3
Mapredtest failure

I am experimenting with some of the tests in hadoop-0.8.0-test.jar and am curious about the possible causes of mapredtest failing. I make the call as follows: bin/hadoop jar hadoop-0.8.0-test.jar ...

Brendan Melville
Nov 9, 2006 at 6:07 pm
Nov 9, 2006 at 6:39 pm
3
why to force a single reduce task for Local Runner?

look at the code: job.setNumReduceTasks(1); // force a single reduce task why? Is there any difficulty there to allow multiple reduce tasks? Best regards, Feng

Feng Jiang
Nov 7, 2006 at 1:49 pm
Nov 8, 2006 at 1:50 am
2
What does "Lost Task Tracker" Mean?

Hello, One error I seem to be getting a lot is "Lost Task Tracker". The two reduce tasks that a particular machine is working on will fail with this error, which then propagates back to all the map ...

Albert Chern
Nov 23, 2006 at 8:37 pm
Nov 27, 2006 at 10:12 pm
2
Unable to format namenode

When running the command bin/hadoop namenode -format, the config file is parsed, and then I am dropped back to the shell. Does anyone have experience with such an issue? Thank you. Brendan

Brendan Melville
Nov 27, 2006 at 2:43 am
Nov 27, 2006 at 7:59 am
2
Appending to a file

Hi All, Is there anyway I can append to an existing file in HDFS? Thanks Jugs

Jagadeesh
Nov 24, 2006 at 1:00 pm
Nov 25, 2006 at 8:14 am
2
How to Display LOG on Console

Hi all: I have encountered one problem about displaying log info on Console. This is the detailed sentence, in order to show it more clearly, I will use the code of wordcount: public class WordCount ...

张茂森
Nov 1, 2006 at 10:52 am
Nov 1, 2006 at 3:13 pm
1
hadoop dfs shell application

Is there a shell someone has written or writing to hadoop? e.g. a simple unix shell that executes file commands to a HDFS such as, ls, rm, cp ...? Thanks -John

John Wang
Nov 18, 2006 at 11:39 pm
Nov 19, 2006 at 5:20 am
1
One map task freezing

Have anyone experienced this? When the cluster is busy sometimes one map task of a job gets stuck. An attempt is then made to kill the task, but this fails. This shows up in the web interface: ...

Johan Oskarsson
Nov 17, 2006 at 5:21 pm
Nov 17, 2006 at 7:58 pm
1
Hadoop and processing of XML files

Hello all, I have been searching through the Hadoop mail archives, but I could not find a relevant answer to my question. Before starting, let me say that I am a newbie, just beginning to explore the ...

Grad0584
Nov 16, 2006 at 3:07 pm
Nov 16, 2006 at 5:30 pm
1
namenode not reachable problem

Hi, I am installing Hadoop for the first time. I am running the name node on the master (node0). In the worker I set the fs.default.name property to node0:40010. After I format the namenode and ...

Anurup Pavuluri
Nov 15, 2006 at 1:24 am
Nov 15, 2006 at 2:36 am
1
How to get start with webapp under hadoop

Hi list, How can I start webapp under hadoop, it seems build.xml has nothing to do with it. -- scott

Scott green
Nov 12, 2006 at 6:37 pm
Nov 12, 2006 at 11:48 pm
0
Problem in fully distributed operation

Hello, I have been following the Getting Started guide to get Hadoop up and running in fully distributed operation but have encountered some problems. The version I'm using is hadoop-0.5.0. I have 2 ...

AaRon
Nov 27, 2006 at 8:37 am
Nov 27, 2006 at 8:37 am
0
Is this possible if i will use the Hadoop to replace the index directory in PHP?

Is this possible if i will use the Hadoop to replace the index directory in PHP? <?php require_once('Zend/Search/Lucene.php'); $index=newZend_Search_Lucene('/data/my_index'); $index- find($query); ? ...

James Zheng
Nov 15, 2006 at 9:50 am
Nov 15, 2006 at 9:50 am
0
Invoke Hadop from Web Interface?

Hi, Currently, I have a web front end for user to do full text index with Lucene on a single server, but is it possible to span the search on several servers, with the help of Hadop, so query time ...

Howard chen
Nov 2, 2006 at 7:04 am
Nov 2, 2006 at 7:04 am
0
Setting task classpath

On each of my nodes that I have deployed Hadoop to I also deployed another large java project. The deployment is in the same place at each node. Is there a way I can set the classpath of each task to ...

Lee
Nov 2, 2006 at 4:16 am
Nov 2, 2006 at 4:16 am