FAQ

Hadoop > common-user > October 2007

Search Discussions

87 discussions - 448 posts

  • Hello! Quick simple question, hopefully someone out there could answer. Does the hadoop dfs support putting multiple files at once? The documentation says -put only works on one file. What's the best ...
    Chris FellowsChris Fellows
    Oct 31, 2007 at 8:50 pm
    Oct 31, 2007 at 10:01 pm
  • Hi,all: I am starting to use hadoop recently,I have 3 questions to ask?Can anybody help me with it? first question:I previously have some code under Windows and some .exe & .dll file.Does hadoop ...
    Vid seaVid sea
    Oct 31, 2007 at 3:44 pm
    Oct 31, 2007 at 4:49 pm
  • hello, I have several questions on the physical storage of the HBase: 1. Does HBase store each table in A format: "com.cnn.www", t6, "<html ...", "com.cnn.www", t5, "<html ...", "com.cnn.www", t3, ...
    Bin YANGBin YANG
    Oct 31, 2007 at 8:03 am
    Oct 31, 2007 at 3:44 pm
  • Hi, It seems as if info.mKind is always kObjectKindDirectory, no matter whether it's a directory or a file. This is using hadoop-0.13.2. Is anyone else having the same problem? Thanks, pete
    Pete WyckoffPete Wyckoff
    Oct 31, 2007 at 1:06 am
    Oct 31, 2007 at 1:06 am
  • Hi All: Environment: 4 node grid running hadoop-0.14.1. With the system shutdown I wiped out the old HDFS directory structure and created an empty directory. Did a namenode format, and then brought ...
    C GC G
    Oct 30, 2007 at 6:06 pm
    Oct 30, 2007 at 8:36 pm
  • Hello @all! I am using Hadoop (version 0.14.3) and I tried to execute Hadoop-Streaming with C. Firstly, I compiled and linked my C-Files, then specified it as mapper and reducer to hadoop-streaming. ...
    Christian KremnitzerChristian Kremnitzer
    Oct 30, 2007 at 3:49 pm
    Oct 31, 2007 at 8:44 am
  • Hi, Can I recursively launch a job within the map() method of a mapper? The task i am facing involves extracting metadata for filenames and catalog names from hierarchical catalogs, and for each ...
    Jim the Standing BearJim the Standing Bear
    Oct 29, 2007 at 8:29 pm
    Oct 30, 2007 at 7:20 pm
  • I setup hadoop on my laptop. when i try start-all.sh the following error happens. I checked hadoop site and didn't find the reason. http://wiki.apache.org/lucene-hadoop Do i need to modify some the ...
    LianLian
    Oct 29, 2007 at 1:44 pm
    Oct 30, 2007 at 6:33 am
  • Hi All, I tried setting up a local filesystem crawl through nutch-0.9. I am facing problems trying this. Following are the details: ------------------------------ CRAWL OUTPUT: Found 1 items ...
    Prem kumarPrem kumar
    Oct 29, 2007 at 4:57 am
    Oct 29, 2007 at 4:57 am
  • Hello, According to a hadoop tutorial (http://wiki.apache.org/nutch/NutchHadoopTutorial) on wiki, "you don't want to search using DFS, you want to search using local filesystems. Once the index has ...
    Paul H.Paul H.
    Oct 27, 2007 at 5:27 pm
    Oct 27, 2007 at 5:27 pm
  • Hello, According to a hadoop tutorial (http://wiki.apache.org/nutch/NutchHadoopTutorial) on wiki, "you don't want to search using DFS, you want to search using local filesystems. Once the index has ...
    Paul H.Paul H.
    Oct 27, 2007 at 4:19 pm
    Oct 27, 2007 at 6:52 pm
  • I was hoping to use -inputformat SequenceFileAsTextInputFormat to process compressed sequencefiles in streaming jobs However, using a python mapper that just echoes out each line as it gets, and ...
    Joydeep Sen SarmaJoydeep Sen Sarma
    Oct 26, 2007 at 7:30 am
    Oct 26, 2007 at 5:20 pm
  • Hi, I was trying HBase from the 0.15 branch. And was doing: HScannerInterface s = table.obtainScanner(...) while(s.next(key, val)) { .... } And encounter the following exception whenever I spent too ...
    Cedric HoCedric Ho
    Oct 26, 2007 at 2:58 am
    Oct 30, 2007 at 1:41 am
  • Hi all I'm getting started with Hadoop and with Yahoo Pig (http://research.yahoo.com/project/pig). I decided to took a look at the code and made some small changes; I announce them here if anyone is ...
    Juan Manuel CaicedoJuan Manuel Caicedo
    Oct 25, 2007 at 4:19 am
    Nov 1, 2007 at 3:30 am
  • I have a corpus of 300,000 raw HTML files that I want to read in and parse using Hadoop. What is the best input file format to use in this case? I want to have access to each page's raw HTML in the ...
    David BalateroDavid Balatero
    Oct 25, 2007 at 12:09 am
    Oct 25, 2007 at 6:41 am
  • http://blog.csdn.net/kauu ----- 原始邮件 ---- 发件人： 谢纲 <xiegang112@gmail.com 收件人： hadoop-user@lucene.apache.org 已发送： 2007/10/8(周一), 下午11:22:38 主题： Re: Is there any doc about DFS of hadoop I have read this ...
    KauuKauu
    Oct 24, 2007 at 1:31 am
    Oct 24, 2007 at 1:31 am
  • I had a somewhat difficult time figuring out how to get hbase started. In the end, it was pretty simple. Here are the steps: 1. Download hadoop from svn, untar to directory say ~/hadooptrunk and ...
    Dennis KubesDennis Kubes
    Oct 22, 2007 at 4:10 am
    Oct 30, 2007 at 5:26 pm
  • Hello my company is considering using a DFS for a project we're currently working on. Since we don't have much experience in the field I've compiled a list of questions that I hope can guide us to ...
    Yoav SteinbergYoav Steinberg
    Oct 21, 2007 at 11:14 am
    Oct 21, 2007 at 5:27 pm
  • Running 0.13.1 - running into this very predictably (some tasks seem to keep timing out). The pattern is like this: - tasktracker says reduce task is not responding: 2007-10-20 18:40:28,225 INFO ...
    Joydeep Sen SarmaJoydeep Sen Sarma
    Oct 21, 2007 at 2:25 am
    Oct 21, 2007 at 2:25 am
  • Hi, I have been studying map reduce and hadoop for the past few weeks, and found it a very new concept. While I have a grasp of the map reduce process as well as being able to follow some of the ...
    Jim the Standing BearJim the Standing Bear
    Oct 20, 2007 at 8:53 pm
    Oct 21, 2007 at 8:11 pm
  • Hi! I am new at clustering, to start a demo cluster what are the steps require to take. Presently I could experimenting with 3 Linux system all latest Intel based with 512 RAM Thanks Sukalyan Banga
    Sukalyan BangaSukalyan Banga
    Oct 20, 2007 at 2:04 pm
    Oct 20, 2007 at 4:39 pm
  • Hi! I am PHP Developer & Linux Administrator. I am very new at hadoop & I have some questions. 1. Is hadoop only configuration based Administration like Linux Administration with scripting ...
    Sukalyan BangaSukalyan Banga
    Oct 20, 2007 at 10:48 am
    Oct 20, 2007 at 3:59 pm
  • Hi, In the original MapReduce paper from Google, it mentioned that healthy workers can take over failed task from other workers. Does Hadoop has the same failure recovery strategy? Also the other ...
    Ming YangMing Yang
    Oct 19, 2007 at 3:05 am
    Oct 20, 2007 at 12:55 pm
  • I am just getting started with HBase. Thinking about using it for future Nutch development. Have successfully build with ant scripts. In the src I see conf and bin directories similar to Hadoop. But ...
    Dennis KubesDennis Kubes
    Oct 18, 2007 at 6:16 pm
    Oct 23, 2007 at 8:45 pm
  • -- Bin YANG Department of Computer Science and Engineering Fudan University Shanghai, P. R. China EMail: yangbinisme82@gmail.com
    Bin YANGBin YANG
    Oct 18, 2007 at 10:14 am
    Oct 22, 2007 at 9:37 pm
  • Hi all, I've previously played with hadoop 0.12.3 and recently downloaded 0.14.2. It seems that hadoop 0.14.2 by default will read the config files in hadoop-0.14.2-core.jar but not the ...
    Cedric HoCedric Ho
    Oct 18, 2007 at 6:15 am
    Oct 18, 2007 at 6:15 am
  • Hi, I'm using the Hadoop 0.14.1 AMI as my master node [ami-64f6130d], and I've followed up to "test your cluster" bit of the tutorial listed here: http://wiki.apache.org/lucene-hadoop/AmazonEC2 ...
    Tiger UppercutTiger Uppercut
    Oct 17, 2007 at 7:55 pm
    Oct 17, 2007 at 11:45 pm
  • I am struggling to control the behavior of the framework. The first problem is simple: I want to run many simultaneous mapper tasks on each node. I've scoured the forums, done the obvious, and I ...
    Lance AmundsenLance Amundsen
    Oct 17, 2007 at 6:27 am
    Oct 25, 2007 at 5:40 pm
  • Hi I have been facing some problems in Hadoop. I find the Namennode to be in safe mode?? May I knw why namenode is in safe mode and what happens when it is in safe mode? Thanks in advance Preethi.C ...
    Preethi ChockalingamPreethi Chockalingam
    Oct 17, 2007 at 5:06 am
    Oct 17, 2007 at 6:08 pm
  • Hi, when use "hadoop dfs -cat" command, I keep getting the problem that says " Could not obtain block 0 from any node: java.io.IOException: No live nodes contain current block" The block does exist ...
    Open StudyOpen Study
    Oct 16, 2007 at 4:41 pm
    Oct 16, 2007 at 7:28 pm
  • Hi there. I did a search of the mailing list archives looking for something similar to this, but I didn't find anything so apologies if this has been discussed before. I'm investigating using Hadoop ...
    Robert JessopRobert Jessop
    Oct 16, 2007 at 3:39 pm
    Oct 18, 2007 at 10:24 am
  • i index by NutchWax.jar and have directory CrawlDb, LinkDb, index, indexes, segments after that i search by Nutch but show error in logs of tomcat that java.lang.IllegalStateException at ...
    JibjoiceJibjoice
    Oct 16, 2007 at 8:52 am
    Oct 24, 2007 at 10:32 am
  • I would like someone to compare and contrast CIFS and HDFS? Or...if that is not a valid comparison...please explain to me why it's not a valid comparison. Thanks, Trevor . This message and any ...
    TrevorstewartTrevorstewart
    Oct 15, 2007 at 7:24 pm
    Oct 17, 2007 at 4:33 pm
  • Hi there, I have upgraded from Hadoop 0.12.2 to 0.14.1 and am working on nutch. All seems to be fine except for Dedup jobs fail with "java.io.IOException". I found someone else get this error which ...
    PvvprPvvpr
    Oct 15, 2007 at 5:20 pm
    Oct 15, 2007 at 5:20 pm
  • Hi all-- I had a subtle bug in a MapReduce job that I was working on related to the fact that my custom key type's hash type (used by the default HashPartitioner) was putting elements that belonged ...
    Chris DyerChris Dyer
    Oct 15, 2007 at 2:11 pm
    Oct 15, 2007 at 9:19 pm
  • Hi, I was writing a test mapreduce program and noticed that the input file was always broken down into separate lines and fed to the mapper. However, in my case I need to process the whole file in ...
    Ming YangMing Yang
    Oct 15, 2007 at 1:59 pm
    Oct 15, 2007 at 9:39 pm
  • Maybe this question should be move to the developer list, but .. it is not that I currently intent to contribute to the project.. I just wanted to see if I could get the code to compile. This is what ...
    Peter ThygesenPeter Thygesen
    Oct 15, 2007 at 1:53 pm
    Nov 26, 2007 at 6:02 pm
  • The input for a M/R job consists of multiple files that are less than a block size and the number of maps is the number of files. I would like to be able to control the number of maps in a way that I ...
    Alejandro AbdelnurAlejandro Abdelnur
    Oct 15, 2007 at 6:23 am
    Oct 24, 2007 at 2:40 pm
  • Hello all I am new to hadoop . I am trying to write file to single cluster and getting this exception when i am trying to close output stream java.io.IOException: CreateProcess: df -k ...
    Dcave555Dcave555
    Oct 13, 2007 at 3:06 pm
    Oct 13, 2007 at 10:21 pm
  • Is there Hadoop UML class and sequence diagram available? Thanks, James Yu
    James YuJames Yu
    Oct 13, 2007 at 12:28 am
    Oct 13, 2007 at 1:32 am
  • We are using hadoop for multiple users and the DFS is using a shared directory for data as noted by FAQ #13. Is there a way to have hadoop use a different classpath per job? Currently if I startup ...
    Xavier StevensXavier Stevens
    Oct 13, 2007 at 12:25 am
    Oct 13, 2007 at 12:25 am
  • Just in case this can help somebody else and because I just spent a couple of hours debugging this, thought I would share and insight. This only affects locally running jobs, not the DFS, and should ...
    Dennis KubesDennis Kubes
    Oct 12, 2007 at 10:48 pm
    Oct 12, 2007 at 10:48 pm
  • Hi All: I am tearing out my hair trying to get a simple valueaggregator to run. This seems like an easy enough thing, but I am consistently getting hit with ClassNotFoundException which makes no ...
    C GC G
    Oct 12, 2007 at 9:43 pm
    Oct 13, 2007 at 4:02 am
  • Does anybody know if there is a jdk6 available for Mac? I checked the apple developer site, and there doesn't seem to be one available, despite blogs from last year claiming apple was distributing ...
    Michael BieniosekMichael Bieniosek
    Oct 12, 2007 at 5:35 pm
    Oct 13, 2007 at 12:36 am
  • Hi All, I am adding two input dir in a job. Both the input dirs have same <Key.class, Value.class . Inside the map method i want to know that which pair<key, value has come from which input dir. How ...
    Shailendra MudgalShailendra Mudgal
    Oct 12, 2007 at 12:52 pm
    Oct 15, 2007 at 4:52 am
  • Hi, I am quite a roobie to webdav. Could you give me some example to deploy hadoop webdav? Thank you! Regards
    贺齐贺齐
    Oct 12, 2007 at 12:22 pm
    Oct 12, 2007 at 12:22 pm
  • Hi, I am using Nutch/Hadoop with single node mode.Nutch failed to generate a new segement and in the hadoop log I find the error message below: 007-10-12 11:09:53,961 INFO crawl.Generator - ...
    Qi wuQi wu
    Oct 12, 2007 at 4:39 am
    Oct 12, 2007 at 4:39 am
  • I'm a rank beginner with clusters, but am determined to move into them, starting with Hadoop. I have a habuntu machine under VMware on my MacBook Pro for starters (got it on a DVD when visiting at ...
    Bob FutrelleBob Futrelle
    Oct 12, 2007 at 3:29 am
    Oct 12, 2007 at 5:08 pm
  • A very basic question: where to store my personal global variables such that the map and/or reduce functions can see it? Thanks, James
    James YuJames Yu
    Oct 12, 2007 at 2:17 am
    Oct 13, 2007 at 9:50 pm
  • Hi All, Does any one have comments about how Hbase will perform in a 4 node cluster compared to an equivalent MySQL configuration? Thanks, Rafael
    Rafael TurkRafael Turk
    Oct 11, 2007 at 10:36 pm
    Oct 13, 2007 at 5:07 am
Oct 2007
12
Group Navigation
period‹ prev | Oct 2007 | next ›
Group Overview
groupcommon-user @
categorieshadoop
discussions87
posts448
users116
websitehadoop.apache.org...
irc#hadoop

116 users for October 2007

Ted Dunning: 48 posts Doug Cutting: 17 posts Owen O'Malley: 16 posts Lance Amundsen: 15 posts Edward yoon: 13 posts Michael Stack: 13 posts Dennis Kubes: 12 posts Jim the Standing Bear: 12 posts Ming Yang: 11 posts Joydeep Sen Sarma: 9 posts Bin YANG: 8 posts Jim Kellerman: 8 posts Stu Hood: 8 posts Arun C Murthy: 7 posts Chris Dyer: 7 posts Preethi Chockalingam: 7 posts 贺齐: 7 posts C G: 6 posts Enis Soztutar: 6 posts James Yu: 6 posts
show more
Archives