Search Discussions

201 discussions - 681 posts

  • Dear Sir/Madam I'm very new to hadoop. I'm trying to install hadoop on my computer. I followed a weblink and try to install it. I want to install hadoop on my single node cluster. i 'm using Ubuntu ...
    Manish YadavManish Yadav
    Mar 2, 2011 at 2:47 pm
    Mar 8, 2011 at 4:26 am
  • I am browsing through the hadoop.io package and was wondering what other file formats are available in hadoop other than SequenceFile and TFile? Is all data written through hadoop including those ...
    Weishung ChungWeishung Chung
    Mar 19, 2011 at 4:02 pm
    Mar 24, 2011 at 12:16 am
  • Hello, I have been struggling with decommissioning data nodes. I have a 50+ data node cluster (no MR) with each server holding about 2TB of storage. I split the nodes into 2 racks. I edit the ...
    Mar 17, 2011 at 1:36 am
    Mar 21, 2011 at 10:40 am
  • I have been wondering if I should use CDH (http://www.cloudera.com/hadoop/) instead of the standard Hadoop distribution. What do most people use? Is CDH free? do they provide the tars or does it ...
    Mar 23, 2011 at 2:29 pm
    Mar 25, 2011 at 11:38 am
  • Dear all, Today I faced a problem while running a map-reduce job in C++. I am not able to understand to find the reason of the below error : 11/03/30 12:09:02 INFO mapred.JobClient: Task Id : ...
    Adarsh SharmaAdarsh Sharma
    Mar 30, 2011 at 6:43 am
    Apr 4, 2011 at 4:21 am
  • We are having difficulties running a Hadoop program making calls to external libraries - but this occurs only when we run the program on our cluster and not from within Eclipse where we are ...
    Ratner, Alan S (IS)Ratner, Alan S (IS)
    Mar 4, 2011 at 8:53 pm
    Mar 12, 2011 at 1:03 am
  • Hi, The last couple of days we have been seeing 10's of thousands of these errors in the logs: INFO org.apache.hadoop.hdfs.DFSClient: Could not complete file ...
    Chris CurtinChris Curtin
    Mar 10, 2011 at 3:34 pm
    Oct 8, 2011 at 8:58 am
  • Hi, guys, I want to give my users a sense of what my hadoop application can do, and I am trying to make it run in Windows, with this command java -jar dist\FreeEed.jar This command runs my hadoop job ...
    Mark KerznerMark Kerzner
    Mar 18, 2011 at 11:03 pm
    Apr 5, 2011 at 8:02 pm
  • Hi, I am doing a pseudo-distributed mode on my laptop, following the same steps I used for all configurations on my regular cluster, but I get this error 2011-03-02 16:45:13,651 INFO ...
    Mark KerznerMark Kerzner
    Mar 2, 2011 at 10:57 pm
    Mar 3, 2011 at 1:01 am
  • Dear all, Can Someone Please tell me how to apply a patch on hadoop-0.20.2 package. I attached the patch. Please find the attachment. I just follow below steps for Hadoop : 1. Download ...
    Adarsh SharmaAdarsh Sharma
    Mar 31, 2011 at 4:11 am
    Mar 31, 2011 at 9:54 am
  • What is the best way to change the rack of a node? I have tried the following: Killed the datanode process. Changed the rackmap file so the node && and ip address entry reflect the new rack and I do ...
    Mar 26, 2011 at 2:35 pm
    Mar 29, 2011 at 12:07 pm
  • Hi, I am a new user to HDFS and am trying to following the instruction on: http://wiki.apache.org/hadoop/MountableHDFS But fuse-dfs fails to load and spits out the following errors: ...
    Mar 8, 2011 at 6:50 pm
    Mar 8, 2011 at 10:10 pm
  • Hey ppl... I need some serious help...I m not able to run kmeans code in hadoop...does anyone have a running code...that they would have tried... Regards MANISH
    Mar 4, 2011 at 1:41 pm
    Mar 4, 2011 at 3:27 pm
  • Dear Hadoop, Which version of ant do I need to keep the hadoop build from failing. Netbeans ant works as well as eclipse ant works. However, ant 1.8.2 does not, nor does the default ant from Ubuntu ...
    Daniel McEnnisDaniel McEnnis
    Mar 27, 2011 at 1:02 am
    Apr 30, 2011 at 3:15 pm
  • Hi there: I'm a new user to Hadoop and Nutch, and I am trying to run the crawler * Nutch* on a distributed system powered by *Hadoop*. However as it turns out, the distributed system does not ...
    Andy XUEAndy XUE
    Mar 24, 2011 at 7:44 am
    Apr 4, 2011 at 8:27 am
  • Good day everyone! First, I want to congratulate the group for this wonderful project. It did open up new ideas and solutions in computing and technology-wise. I'm excited to learn more about it and ...
    Franco NazarenoFranco Nazareno
    Mar 29, 2011 at 1:05 pm
    Mar 31, 2011 at 7:18 am
  • hi,guys: I want to monitor each tasks' io usage, do can I get each task's process id? I used jvmManager.getPid(tip.getTaskRunner()); but it didn't seem to be the task's process. Thanks zhutao
    Mar 29, 2011 at 2:53 pm
    Mar 30, 2011 at 1:46 pm
  • Hi, I'm making a comparison between the following compression methods: gzip and lzo provided by Hadoop and gzip from package java.util.zip. The test consists of compression and decompression of ...
    José Vinícius Pimenta ColettoJosé Vinícius Pimenta Coletto
    Mar 2, 2011 at 8:11 pm
    Mar 29, 2011 at 10:54 pm
  • Sorry but it doesn't look like Chukwa mailing list exists anymore? Is there an easy way to set up lightweight agents on cluster of machines instead of downloading the full Chukwa source (+50mb)? Has ...
    Mar 20, 2011 at 3:44 pm
    Mar 21, 2011 at 5:34 am
  • Dear all, I followed a fantastic tutorial and able to run the Wordcont C++ Program in Hadoop Cluster. http://cs.smith.edu/dftwiki/index.php/Hadoop_Tutorial_2.2_--_Running_C%2B%2B_Programs_on_Hadoop ...
    Adarsh SharmaAdarsh Sharma
    Mar 4, 2011 at 5:14 am
    Mar 13, 2011 at 3:24 pm
  • Hi, Is there a way to disable the use of pipelining , i.e., the reduce phase is started only after the map phase is completed? -bikash
    Bikash sharmaBikash sharma
    Mar 1, 2011 at 2:14 pm
    Mar 12, 2011 at 6:04 pm
  • Hello all, I installed hadoop0.20.2 on physical machines and everything works like a charm. Now I installed hadoop using the same hadoop-install gz file on the cloud. Installation seems fine. I can ...
    Praveen PeddiPraveen Peddi
    Mar 3, 2011 at 10:19 pm
    Mar 9, 2011 at 2:34 am
  • Hello All, Is there a parameter or procedure to check more aggressively for a live/dead node? Despite me killing the hadoop process, I see the node active for more than 10+ minutes in the "Live ...
    Mar 29, 2011 at 12:14 pm
    Mar 30, 2011 at 3:53 pm
  • Hi list, I am having problems to setup Hadoop for Eclipse. I followed the instructions under: http://wiki.apache.org/hadoop/EclipseEnvironment Since I want to debug MapReduce jobs in distributed ...
    Mar 23, 2011 at 3:12 pm
    Mar 25, 2011 at 1:54 pm
  • Does anyone see this? Can someone at least respond to this to indicate that it's getting to the mailing list fine? I've just gotten 0 replies to a few previous emails so I'm wondering if it's nobody ...
    Aaron BaffAaron Baff
    Mar 22, 2011 at 5:19 pm
    Mar 25, 2011 at 2:59 am
  • I am running a hadoop program processing Tera Byte size data. The code was test successfully on a small sample (100G) and it worked. However, when trying it on the full problem, the program freezes ...
    Shi YuShi Yu
    Mar 24, 2011 at 6:59 pm
    Mar 25, 2011 at 1:41 am
  • Hi all, When I use command "hadoop fs -text" I need to add extra jar to CLASSPATH, because there's custom type in my sequence file. One way is that copying jar to $HADOOP_HOME/lib But in my case, I ...
    Jeff ZhangJeff Zhang
    Mar 23, 2011 at 1:19 am
    Mar 23, 2011 at 2:37 am
  • Whats the deal with Chukwa? Mailing list doesn't look like its alive as well as any of the download options??? http://www.apache.org/dyn/closer.cgi/incubator/chukwa/ Is this project dead?
    Mar 20, 2011 at 4:38 pm
    Mar 21, 2011 at 10:06 pm
  • The sqoop documentation seems to imply that it uses the key information provided to it on the command line to ensure that the SQL data is distributed evenly across the DFS. However I cannot see any ...
    Mar 16, 2011 at 11:34 pm
    Mar 17, 2011 at 9:55 pm
  • On HDFS, anyone can run hadoop fs -rmr /* and delete everything. The permissions system minimizes the danger of accidental global deletion on UNIX or NT because you're less likely to type an ...
    W.P. McNeillW.P. McNeill
    Mar 16, 2011 at 5:36 pm
    Mar 16, 2011 at 9:39 pm
  • Dear users, hope this is the right list to submit this one, otherwise I apologize. I'd like to have your opinion about a problem that I'm facing on MapReduce framework. I am writing my code in Java ...
    Luca AielloLuca Aiello
    Mar 10, 2011 at 7:51 pm
    Mar 10, 2011 at 10:42 pm
  • Hi, I am sorry if this question was asked a lot of times before but I am unable to solve my problem. I am trying to build hadoop 0.21.0 from the source. As far as my understanding goes, I need to ...
    Daniel Aris Pandu PrasetiaDaniel Aris Pandu Prasetia
    Mar 7, 2011 at 7:53 pm
    Mar 8, 2011 at 10:23 pm
  • Hi, Kerberos has been configured for our Hadoop file system. I wish to do the authentication through a Java program. I'm able to perform the authentication using a normal java application. But, if ...
    Mar 21, 2011 at 9:29 am
    Sep 22, 2011 at 6:15 am
  • I have trouble browsing the file system vi namenode web interface, namenode saying in log file that th –G option is invalid to get the groups for the user.
    Mar 31, 2011 at 2:44 pm
    Apr 4, 2011 at 5:13 am
  • Hey guys, I'm new here, and recently I'm working on configuring a cluster with 32 nodes. However, there are some problems, I describe below The cluster consists of nodes, which I don't have "root" to ...
    Ke xieKe xie
    Mar 30, 2011 at 10:09 am
    Mar 31, 2011 at 6:05 am
  • hi, I run almost 60 ruduce tasks for a single job. if the outputs of a job are from part00 to part 59. is there way to write rows sequentially by sorted keys? curretly my outputs are like this. ...
    JunYoung KimJunYoung Kim
    Mar 22, 2011 at 2:24 pm
    Mar 25, 2011 at 11:24 am
  • This webpage: http://hadoop.apache.org/common/docs/r0.18.3/streaming.html contains this passage: [BEGIN] How do I process files, one per map? As an example, consider the problem of zipping ...
    Keith WileyKeith Wiley
    Mar 24, 2011 at 5:27 am
    Mar 24, 2011 at 4:10 pm
  • Hey my fellow hadoop/hbase developers, I just came across this google compression/decompression package yesterday, could we make a good use of this compression scheme in hadoop? It's written in C++ ...
    Weishung ChungWeishung Chung
    Mar 23, 2011 at 7:46 pm
    Mar 23, 2011 at 7:54 pm
  • hi guys,,, I want to running hodoop in Android (dalvik virtual machine) but I have some problem with library or something else. there anybody knows to solve this problem?
    Irsan RajaminIrsan Rajamin
    Mar 21, 2011 at 12:20 pm
    Mar 22, 2011 at 5:35 pm
  • Hi, I see there are various posts claiming hadoop is available through official debian mirrors (for debian squeeze, i.e. stable): * ...
    Dieter PlaetinckDieter Plaetinck
    Mar 15, 2011 at 10:50 am
    Mar 21, 2011 at 10:41 am
  • Hello, I'm stuck with this for two days now ...I found a previous post discussing this, but not with arrays. I know how to write Writable class with primitive type elements but this time I'm using an ...
    Mar 17, 2011 at 9:05 pm
    Mar 18, 2011 at 4:59 pm
  • Hi, I am following a setup guide here: http://wiki.apache.org/hadoop/AmazonEC2 but runs into problems when I tried to launch a cluster. An error message said ...
    JJ siungJJ siung
    Mar 12, 2011 at 6:04 pm
    Mar 13, 2011 at 5:47 pm
  • Dear all, I have configured several times a Hadoop Cluster of 2,3,5,8 nodes but one doubt in my mind always occur. Why it is necessary to format Hadoop Namenode by *bin/hadoop -namenode format ...
    Adarsh SharmaAdarsh Sharma
    Mar 10, 2011 at 4:23 am
    Mar 10, 2011 at 11:24 pm
  • I'm trying to install LZO on CDH3B3, using the LZO Packager tool here ( https://github.com/toddlipcon/hadoop-lzo-packager) I'm running the following on Centos 5.5. I'm not an expert on RPM building. ...
    Phil youngPhil young
    Mar 5, 2011 at 10:57 pm
    Mar 8, 2011 at 11:00 pm
  • Hi. my hadoop application generated several output files by a single job. (for example, A, B, C are generated as a result) after finishing a job, I want to count each files' row counts. is there any ...
    Jun Young KimJun Young Kim
    Mar 8, 2011 at 9:44 am
    Mar 8, 2011 at 2:46 pm
  • Hello, are the restrictions to the size or "width" of text files placed in HDFS? I have a file structure like this: <text key <tab <text data <nl It would be helpful if in some circumstances I could ...
    Kelly BurkhartKelly Burkhart
    Mar 4, 2011 at 7:31 pm
    Mar 4, 2011 at 8:46 pm
  • Hi, in my small development cluster I have a master/slave node and a slave node, and I shut down the slave node at night. I often see that my HDFS is corrupted, and I have to reformat the name node ...
    Mark KerznerMark Kerzner
    Mar 3, 2011 at 11:45 pm
    Mar 4, 2011 at 4:32 am
  • I realize that the intended purpose of speculative execution is to overcome individual slow tasks...and I have read that it explicitly is *not* intended to start copies of a task simultaneously and ...
    Keith WileyKeith Wiley
    Mar 2, 2011 at 9:01 pm
    Mar 3, 2011 at 11:52 pm
  • Hi, I have subscribed to the digest mode, but I still get all the messages instantly from other people in the list. But other mailing list won’t do this, they will send all the messages during a time ...
    Mar 31, 2011 at 1:01 pm
    Apr 4, 2011 at 6:23 am
  • Hi, I've been running hadoop 0.20.2 for a while now on 2 different clusters that I setup. Now on this new cluster I can't get the namenode to stay up. It exits with a IOException "incomplete hdfs ...
    Bill BruneBill Brune
    Mar 29, 2011 at 10:30 pm
    Mar 30, 2011 at 7:53 pm
Group Navigation
period‹ prev | Mar 2011 | next ›
Group Overview
groupcommon-user @

181 users for March 2011

Harsh J: 57 posts Adarsh Sharma: 28 posts Maha: 28 posts James Seigel: 22 posts Keith Wiley: 20 posts Mark Kerzner: 18 posts Ted Dunning: 18 posts Steve Loughran: 16 posts Bikash sharma: 13 posts Brian Bockelman: 13 posts Michael Segel: 12 posts Rita: 12 posts Mark: 11 posts Shi Yu: 11 posts Icebergs: 10 posts JunYoung Kim: 10 posts Weishung Chung: 10 posts Manish Yadav: 9 posts Bibek Paudel: 7 posts Matthew John: 7 posts
show more