Search Discussions

26 discussions - 74 posts

  • jobtracker.jsp shows the list of TaskTrackers over the course of a job -- in a HADOOP-16 -like manner -- shrinking. No errors show in the jobdetails.jsp to explain the disappeared. I see this ...
    Mar 3, 2006 at 5:10 pm
    Mar 7, 2006 at 6:51 pm
  • Trying Hadoop out with a proof of concept I came across the following problem. My input looks conceptually like this: textid1, number1, number2, number3 textid2, number2, number2, number3 textid1, ...
    Teppo KurkiTeppo Kurki
    Mar 29, 2006 at 3:04 pm
    Mar 31, 2006 at 7:24 am
  • Hello Team, I created a backup of my DFS database: # bin/hadoop dfs -copyToLocal /user/root/crawl /mylocaldir I now want to restore from the backup using: # bin/hadoop dfs -copyFromLocal ...
    Monu OgbeMonu Ogbe
    Mar 29, 2006 at 1:53 pm
    Mar 29, 2006 at 5:59 pm
  • Thanks Andrzej, Works a treat, which is more than I can say for my thoroughly broken DFS :( I used: # bin/hadoop org.apache.hadoop.dfs.DFSck /user/root/crawl and got! Status: CORRUPT Total size: ...
    Monu OgbeMonu Ogbe
    Mar 23, 2006 at 7:47 pm
    Mar 27, 2006 at 7:44 pm
  • hi. i'm trying to get hadoop running in the pseudo distributed configuration and have checked out the latest code and used the instructions located in the API: ...
    Snehal PatelSnehal Patel
    Mar 3, 2006 at 5:28 am
    Mar 4, 2006 at 2:07 am
  • Why would a lightly loaded nameserver w/ no other emissions on a seemingly healthy machine have trouble allocating blocks in a job that is almost done? From the nameserver log: 060323 173126 Server ...
    Michael StackMichael Stack
    Mar 23, 2006 at 5:48 pm
    Mar 24, 2006 at 4:44 am
  • Does Hadoop run multiple threads on a single slave? In my current experiment, I'm running with three slaves, each of which has four processors. Hadoop only appears to be using one processor on each ...
    Andrew McNabbAndrew McNabb
    Mar 22, 2006 at 10:53 pm
    Mar 23, 2006 at 12:06 am
  • Hello, Hadoop wiki could use some configuration ;) Jeff.
    Jeff RitchieJeff Ritchie
    Mar 4, 2006 at 9:17 pm
    Mar 7, 2006 at 8:39 pm
  • Hi, I have some problem with classloading in hadoop. I had written a set of mapper and reducers with a set of custom writable implementations. Also my classes require nutch writables. I'm able to get ...
    Stefan GroschupfStefan Groschupf
    Mar 3, 2006 at 6:07 pm
    Mar 3, 2006 at 7:29 pm
  • Dear Hadoop users and developers, I have been evaluating Hadoop with a view to using it as a distributed computing platform for performing fast operations on locally stored data. I have found several ...
    Dan BrethertonDan Bretherton
    Mar 30, 2006 at 7:14 pm
    Mar 31, 2006 at 9:12 pm
  • Whoever added the names field to the general administration webpage of the jobtracker thank you. It is a very big help to see what the jobs are and the order in which they run. Dennis
    Dennis KubesDennis Kubes
    Mar 31, 2006 at 6:04 pm
    Mar 31, 2006 at 7:03 pm
  • Hi all Anyone subscribed to this yet? ;-) Anyhoo, I'm fairly new to hadoop and was wondering about the redundancy aspects of it. If I have a few servers running for nutch, one being a name and data ...
    Aled JonesAled Jones
    Mar 29, 2006 at 3:23 pm
    Mar 29, 2006 at 6:04 pm
  • So, I've just worked my way through the GFS whitepaper (mapreduce is next), and was wondering what the major design/architecture differences are compared with Hadoop's DFS. The JavaDoc points out ...
    Yonik SeeleyYonik Seeley
    Mar 14, 2006 at 4:42 pm
    Mar 14, 2006 at 5:23 pm
  • Below are some exceptions gleaned from tasktracker logs. I was wondering if others are seeing similar and if suggestions on how to avoid/fix them. First, the general setting is a rack of 35 ...
    Michael StackMichael Stack
    Mar 8, 2006 at 6:10 pm
    Mar 8, 2006 at 8:22 pm
  • Anyone else seeing these on startup of a job in fresh update from this morning (Revision: 382439)? 060302 170405 Server handler 0 on 50050 call error: java.io.IOException: ...
    Mar 2, 2006 at 6:03 pm
    Mar 3, 2006 at 12:19 am
  • Hello Team, I have installed hadoop-2006-03-01.tar.gz, and configured hadoop-site.xml. The initial sanity tests from the tutorials worked fine until I start jobtracker the feedback looks as if it ...
    Monu OgbeMonu Ogbe
    Mar 2, 2006 at 5:53 pm
    Mar 2, 2006 at 7:46 pm
  • Currently Even with the local option set, I am able to see many submit_file and job.jar and job.xml Is'nt this supposed to be used by the task tracker? So having a local option should not be creating ...
    Raghavendra PrabhuRaghavendra Prabhu
    Mar 31, 2006 at 5:31 am
    Mar 31, 2006 at 5:31 am
  • Hi I currently run hadoop with local option. Does this mean that still map reduce will work on the local system? If that is so, then hadoop incorporates two things 1)distributed file system 2) map ...
    Raghavendra PrabhuRaghavendra Prabhu
    Mar 31, 2006 at 5:26 am
    Mar 31, 2006 at 5:26 am
  • Hi, I updated to the latest source updated my installation and restarted the system with start-all.sh. I note that tasktrackers need up to several minutes to connect to the jobtracker. I saw in the ...
    Stefan GroschupfStefan Groschupf
    Mar 30, 2006 at 1:34 pm
    Mar 30, 2006 at 1:34 pm
  • Hi, I've written several MapReduce jobs. However, I noticed the jobs took a long time to finish due to sort and reduce. I run tasks with 1 reducer. Is there a guideline on how many reduce task? If ...
    Joseph WangJoseph Wang
    Mar 27, 2006 at 3:17 am
    Mar 27, 2006 at 3:17 am
  • Hello Team, I am running nutch with mapreduce/DFS using: - nutch-0.8-dev (rev="387659" of 2006-03-23) with - hadoop-0.1-dev (rev="387664") built and merged into <nutchdir /lib/hadoop - A cluster of 6 ...
    Monu OgbeMonu Ogbe
    Mar 26, 2006 at 1:03 pm
    Mar 26, 2006 at 1:03 pm
  • Hi, Is there a way to make sure the job is actually got distributed to different nodes? Is there a command to check the task status associated with each box? On the slave box's log, I see ...Lost ...
    Joseph WangJoseph Wang
    Mar 23, 2006 at 12:56 am
    Mar 23, 2006 at 12:56 am
  • I want to setup two servers and to run example program. I put the following into hadoop-site.xml and run bin/start-all.sh on both nodes. However, when I try to run ...
    Joseph WangJoseph Wang
    Mar 21, 2006 at 4:35 am
    Mar 21, 2006 at 4:35 am
  • Yesterday I wrote of a hung rack. In that case -- after consultation w/ DC -- it looked like the map output files had been removed prematurely for some unknown reason. Subsequently, the rack is stuck ...
    Mar 9, 2006 at 7:11 pm
    Mar 9, 2006 at 7:11 pm
  • Hi, I'm curious if anyone has tried to run Hadoop on the Sun Grid. http://www.sun.com/service/sungrid/overview.jsp If so, would you consider posting any experiences, frustrations, or other ...
    Curt CoxCurt Cox
    Mar 9, 2006 at 4:50 pm
    Mar 9, 2006 at 4:50 pm
  • So, I was sick for a week, before which I'd been a week or so since I'd touched the hadoop work I've been doing. I left the namenode/datanodes running during that time, so that disk failures and ...
    Bryan A. PendletonBryan A. Pendleton
    Mar 8, 2006 at 1:17 am
    Mar 8, 2006 at 1:17 am
Group Navigation
period‹ prev | Mar 2006 | next ›
Group Overview
groupcommon-user @

26 users for March 2006

Doug Cutting: 16 posts Stack: 10 posts Monu Ogbe: 6 posts Dennis Kubes: 3 posts Hairong Kuang: 3 posts Joseph Wang: 3 posts Snehal Patel: 3 posts Stefan Groschupf: 3 posts Teppo Kurki: 3 posts Andrew McNabb: 2 posts Andrzej Bialecki: 2 posts Eric Baldeschwieler: 2 posts Jeff Ritchie: 2 posts Monu Ogbe: 2 posts Raghavendra Prabhu: 2 posts Yoram Arnon: 2 posts Aled Jones: 1 post Bryan A. Pendleton: 1 post Curt Cox: 1 post Dan Bretherton: 1 post
show more