Search Discussions

127 discussions - 474 posts

  • Hi there, I am trying to get Hadoop on Demand up and running, but am having problems with the ringmaster not being able to communicate with HDFS. The output from the hod allocate command ends with ...
    David MilneDavid Milne
    Jun 10, 2010 at 2:57 am
    Jun 15, 2010 at 8:48 pm
  • Folks, I need some help on job tracker. I am running a two hadoop clusters (with 30+ nodes) on Ubuntu. One is with version 0.19.1 (apache) and the other one is with version 0.20. 1+169.68 (Cloudera). ...
    Li, TanLi, Tan
    Jun 17, 2010 at 9:00 pm
    Jun 24, 2010 at 6:36 am
  • Hi all, I'm doing some tuning of the sort benchmark of hadoop. To be more specified, running test against the org.apache.hadoop.examples.Sort class. As looking through the source code, I think the ...
    Jun 17, 2010 at 12:45 pm
    Jun 18, 2010 at 6:30 am
  • Hi. Was the append functionality finally added to 0.20.1 version? Also, is the ability to seek file being written and write data in other place also supported? Thanks in advance!
    Stas OskinStas Oskin
    Jun 10, 2010 at 12:11 pm
    Jun 14, 2010 at 3:56 pm
  • Hi, i have running a 4-node cluster with hadoop-0.20.2. Now i suddenly run into a situation where every task scheduled on 2 of the 4 nodes failed. Seems like the child jvm crashes. There are no child ...
    Johannes ZillmannJohannes Zillmann
    Jun 14, 2010 at 5:16 pm
    Jun 17, 2010 at 12:07 pm
  • hi, I am running a mapreduce job on my hadoop cluster. I am running a 10 gigabytes data and one tiny failed task crashes the whole operation. I am up to 98% complete and throwing away all the ...
    Edward choiEdward choi
    Jun 30, 2010 at 12:31 am
    Jul 6, 2010 at 5:08 am
  • Hi everyone :) There's something I'm probably doing wrong but I can't seem to figure out what. I have two hadoop programs running one after the other. This is done because they don't have the same ...
    Pierre ANCELOTPierre ANCELOT
    Jun 30, 2010 at 9:35 am
    Jun 30, 2010 at 5:05 pm
  • Hi All, I am new to Hadoop, but by reading online docs and other resource, I have moved ahead and now trying to run a cluster of 3 nodes. Before doing this, tried my program on standalone and pseudo ...
    Siddharth KarandikarSiddharth Karandikar
    Jun 29, 2010 at 3:13 pm
    Jul 6, 2010 at 1:29 am
  • Can someone tell me what "hadoop namenode -format" does under the hood? I have started my HDFS cell with the following configuration. ------------------- dfs.data.dir /opt/hadoop/data ...
    Sean BigdatafunSean Bigdatafun
    Jun 24, 2010 at 3:14 pm
    Jun 25, 2010 at 2:22 pm
  • Hey all. Im trying to start up a psuedo distributed setup following the directions in Hadoop In Action however I am having problems. For some reason my TaskTracker and JobTracker are not starting up ...
    Jun 24, 2010 at 4:41 am
    Jun 24, 2010 at 5:45 pm
  • Hi. What is the state of high-availability in Hadoop 0.20.1? In Hadoop 0.18.3 the only option was doing DBRD, has anything changed in 0.20.1? Regards.
    Stas OskinStas Oskin
    Jun 24, 2010 at 4:44 pm
    Jun 25, 2010 at 2:46 am
  • I need to execute a code through the propmt of hadoop,i.e; bin/hadoop . So, I built the jar of it using jar cfmv Jarfile_name Manifest_filename -C directory_name/ .(in which d jars,and class files ...
    Sugandha NaolekarSugandha Naolekar
    Jun 18, 2010 at 4:12 am
    Jun 18, 2010 at 4:16 pm
  • Hi , My hadoop job writes results of map/reduce to HBase. I have 3 reducers. Here is a sequence of input and output parameters for Mapper , Combiner and Reducer *input: InputFormat<K1,V1 mapper: ...
    Oleg RuchovetsOleg Ruchovets
    Jun 9, 2010 at 8:18 am
    Jun 10, 2010 at 4:28 pm
  • Hi, I wanted to ask if it is possible to intercept every communication that takes place between hadoop's map reduce task i.e between JobTracker and TaskTracker and make it pass through my own ...
    Ahmad ShahzadAhmad Shahzad
    Jun 10, 2010 at 10:26 am
    Jun 10, 2010 at 3:39 pm
  • Hi all, As we all know, machines in hadoop cluster may be both datanode and tasktracker, so one machine may store both MR job intermediate data and HDFS data. My question is: if we have more than one ...
    Yu LiYu Li
    Jun 29, 2010 at 4:33 am
    Jul 1, 2010 at 7:52 am
  • According to hadoop tutorial on Yahoo developer netwrok and hadoop documentation on apache, a simple way to achieve namenode backup and recovery from single point namenode failure is to use a folder ...
    Jiang lichtJiang licht
    Jun 21, 2010 at 5:43 pm
    Jun 24, 2010 at 12:16 am
  • Dear all, I am a new Hadoop user and am confused a little bit about the difference between Hadoop and MapReduce. Could anyone please clear me? Thanks! Simon
    Simon NarowkiSimon Narowki
    Jun 10, 2010 at 8:32 pm
    Jun 11, 2010 at 6:16 pm
  • Hi, When i started hadoop daemons with start-dfs.sh the namenode fail to run only the secondarynamenode and the datanode run what is the problem here and how can i run the namenode?? thanks a lot for ...
    Khaled BEN BAHRIKhaled BEN BAHRI
    Jun 2, 2010 at 12:19 pm
    Jun 3, 2010 at 8:14 am
  • Hi, Sorry for the cross-post. But just trying to see if anyone else has had this issue before. Thanks ---------- Forwarded message ---------- From: bmdevelopment <bmdevelopment@gmail.com Date: Fri, ...
    Jun 28, 2010 at 1:10 pm
    Jul 28, 2010 at 9:52 am
  • Hi, Is there a json writablecomparable implementation anywhere? Thanks, Oded
    Oded RotemOded Rotem
    Jun 30, 2010 at 5:39 am
    Jul 1, 2010 at 11:00 am
  • Hi again. I noticed a kfs jars in Hadoop distribution, does it mean the KFS is now bult-in into Hadoop? Regards.
    Stas OskinStas Oskin
    Jun 17, 2010 at 12:05 pm
    Jun 21, 2010 at 9:31 am
  • Is it possible to use libhdfs in conjunction with hadoop pipes? At runtime, I am getting an error that says it can't find libhdfs.so.0. I deployed hadoop using one of cloudera's distribution ...
    Poole, Samuel [USA]Poole, Samuel [USA]
    Jun 16, 2010 at 2:52 pm
    Jun 17, 2010 at 9:07 pm
  • Hi, I know it may not be suitable to be posted here since it relates to EC2 more than Hadoop. However I could not find a solution and hope some one here could kindly help me out. Here is my question. ...
    Mo ZhouMo Zhou
    Jun 1, 2010 at 8:23 pm
    Jun 3, 2010 at 4:41 am
  • Hi, I am wondering whether Hadoop has some dependencies on ZooKeeper or not. I mean when I download http://apache.thelorne.com/hadoop/core/hadoop-0.20.2/hadoop-0.20.2.tar.gz does it has ZooKeeper ...
    Jun 28, 2010 at 2:09 pm
    Jul 6, 2010 at 1:53 am
  • In addition to default FIFO scheduler, there are fair scheduler and capacity scheduler. In some sense, fair scheduler can be considered a user-based scheduling while capacity scheduler does a ...
    Jiang lichtJiang licht
    Jun 28, 2010 at 10:45 pm
    Jun 29, 2010 at 9:34 am
  • Is it configurable? Thanks, --Michael
    Jiang lichtJiang licht
    Jun 25, 2010 at 1:02 am
    Jun 25, 2010 at 5:48 pm
  • Hi This looks like a trivial problem but would be glad if someone can help.. I have been trying to run a m-r job on my cluster. I had modified my configs (primarily reduced the heap sizes for the ...
    Vidhyashankar VenkataramanVidhyashankar Venkataraman
    Jun 23, 2010 at 9:07 am
    Jun 23, 2010 at 5:15 pm
  • Hi everyone, I have a program that generates the data that's supposed to be treated by hadoop. It's a java program that should write right on hdfs. So as a test, I do this: Configuration config = new ...
    Pierre ANCELOTPierre ANCELOT
    Jun 23, 2010 at 8:23 am
    Jun 23, 2010 at 2:30 pm
  • Hi, I am upgrading my code from hadoop-0.19.2 to hadoop-0.20.2, during the process I found that there was no KeyValueTextInputFormat class which exists in hadoop-0.19.2. It's so strange that this ...
    Kevin TseKevin Tse
    Jun 14, 2010 at 2:54 pm
    Jun 21, 2010 at 4:13 am
  • Hello, HDFS supports http read-only access to filesystem. Is it possible to use wget to download file using some url like http://<namenode :<web<http://%3cnamenode%3e:%3cweb gui port /.. Thanks ...
    Jaydeep AyachitJaydeep Ayachit
    Jun 15, 2010 at 1:43 pm
    Jun 15, 2010 at 6:15 pm
  • Hi List, I need to explain an higher than expected throughput (bandwidth) for a HDFS C API Client. Specifically, the client is getting bandwidth higher than its link rate :). The client is first ...
    Patrick DonnellyPatrick Donnelly
    Jun 11, 2010 at 5:06 pm
    Jun 14, 2010 at 9:42 pm
  • configuration changes can be captured and applied (some of them) w/o restarting hadoop services on both master and slave boxes. Thank, --Michael
    Jiang lichtJiang licht
    Jun 29, 2010 at 11:28 pm
    Jun 30, 2010 at 7:17 pm
  • I am currently looking into importing all of our application log files (~100+ host machines) into HDFS. Can someone point me in the right direction or walk me through the process of how I can ...
    Jun 29, 2010 at 12:10 am
    Jun 29, 2010 at 5:48 pm
  • I get the following exception when running scanner in hbase: 2010-06-29 14:58:28,262 INFO org.apache.zookeeper.ClientCnxn: Closing ClientCnxn for session: 0x29821273e10001 2010-06-29 14:58:28,269 ...
    Jun 29, 2010 at 8:10 am
    Jun 29, 2010 at 12:44 pm
  • Hi, I would like to run a hadoop job that write to multiple output files. I see a class called MultipleOutputFormat that looks like what I want, but I have not been able to find any sample code ...
    Adam SilbersteinAdam Silberstein
    Jun 29, 2010 at 12:36 am
    Jun 29, 2010 at 3:45 am
  • Hello, I am trying some simple code snippet to create a new file. And after create and write to the file, I want to use "sync()" to synchronize all replicas. However, I got "LeaseExpiredException" in ...
    Elton skyElton sky
    Jun 26, 2010 at 4:28 am
    Jun 27, 2010 at 12:44 pm
  • I still haven't figured out how to query the JobTracker for a specific running job using the new API. Is this at all possible? The old/new APIs are driving me crazy. As far as I understand the old ...
    Some BodySome Body
    Jun 21, 2010 at 1:31 pm
    Jun 22, 2010 at 8:32 am
  • Hello, I've noticed people send emails to the following address: hadoop-user@lucene.apache.org Why? Is this supposed to be related to common-user@hadoop.apache.org list? But why would any Hadoop ...
    Otis GospodneticOtis Gospodnetic
    Jun 18, 2010 at 5:23 am
    Jun 18, 2010 at 5:42 pm
  • Hi I am getting this strange error in the target "compile-mapred- classes:" when compiling map-reduce on Mac OS X. The JAVA_HOME is properly set , and if I remove <jsp-compile from compile-mapred- ...
    Asif JanAsif Jan
    Jun 16, 2010 at 12:36 pm
    Jun 17, 2010 at 12:48 pm
  • I am new to hadoop. downloaded version 0.20.2 and installed it on local mode. Run wordcount examples and others successfully, however, I am trying to run the hadoop-streaming example: ...
    Michael RobinsonMichael Robinson
    Jun 12, 2010 at 6:41 pm
    Jun 12, 2010 at 8:44 pm
  • Hi all, Why does the default packet size in HDFS is 64k? How do we know 64k is the best for all platforms? Thanks a lot. Shen
    Jun 7, 2010 at 1:00 am
    Jun 8, 2010 at 1:19 am
  • Hi, When the user calling FileSystem.copyFromLocalFile() doesn't have permission to write to certain hdfs path: Thread [main] (Suspended (exception AccessControlException)) DFSClient.mkdirs(String, ...
    Ted YuTed Yu
    Jun 2, 2010 at 6:57 pm
    Jun 3, 2010 at 1:54 am
  • Hi , I use HDFS Shell to copy files from local FileSystem to Hadoop HDFS. (copyFromLocal command). 1) How can I provide Path to file which locates on local FS but on different machine then hadoop ...
    Oleg RuchovetsOleg Ruchovets
    Jun 30, 2010 at 8:59 am
    Jun 30, 2010 at 9:11 pm
  • Hi everyone :) Monday morning always comes with some logs reviews of the weekend.... And sometimes, strange surprises.... :) Do anyone understand what happens here or do I have to dive in the source ...
    Pierre ANCELOTPierre ANCELOT
    Jun 28, 2010 at 7:39 am
    Jun 28, 2010 at 4:10 pm
  • Hi , I am new to Hadoop, I want to know how to connect to Namenode from an external system(client). Do i have to hard-code the IP address of namenode or is there a way to find out the IP address of ...
    Jun 25, 2010 at 5:24 am
    Jun 25, 2010 at 7:18 pm
  • Hi, I Mr. Adarsh Sharma presently working in Hadoop technologies from the last 3 months.. I have a 20 GB file numb_complete.txt. I load it into HDFS. Now I have integrated ...
    Adarsh SharmaAdarsh Sharma
    Jun 24, 2010 at 12:46 pm
    Jun 24, 2010 at 12:46 pm
  • Hi, I am new to hadoop programming. I am trying to copy a local file to HDFS. My code snippet is: . . Configuration conf = new Configuration(); InputStream in=null; OutputStream out = null; try { in ...
    Elton skyElton sky
    Jun 24, 2010 at 6:43 am
    Jun 24, 2010 at 11:46 am
  • Hi. What minimal libraries I would need for DFS operations? Previously it was a single library called hadoop-0.18.3-14.cloudera.CH0_3-core.jar (for Cloudera distrobution), but now I see it got ...
    Stas OskinStas Oskin
    Jun 17, 2010 at 12:02 pm
    Jun 23, 2010 at 3:55 pm
  • Hi, We had a power failure... after restarting the nodes, I try to start the namenode... Any idea please? Thanks :) $ bin/hadoop namenode 10/06/22 09:24:30 INFO namenode.NameNode: STARTUP_MSG: ...
    Pierre ANCELOTPierre ANCELOT
    Jun 22, 2010 at 7:27 am
    Jun 22, 2010 at 3:42 pm
  • Hi Hadoopers, I have received WARN in the hadoop cluster. Has anybody seen this . Any solution? "Legal Disclaimer: This electronic message and all contents contain information from Cybage Software ...
    Bikash SinghalBikash Singhal
    Jun 21, 2010 at 9:32 am
    Jun 21, 2010 at 6:33 pm
Group Navigation
period‹ prev | Jun 2010 | next ›
Group Overview
groupcommon-user @

155 users for June 2010

Ted Yu: 34 posts Stas Oskin: 19 posts Steve Loughran: 14 posts Allen Wittenauer: 13 posts Hemanth Yamijala: 13 posts Edward Choi: 12 posts Jiang licht: 12 posts Jeff Zhang: 11 posts 李钰: 11 posts Elton sky: 10 posts Pierre ANCELOT: 10 posts Kevin Tse: 9 posts Amogh Vasekar: 8 posts Todd Lipcon: 8 posts David Milne: 7 posts Edward Capriolo: 7 posts Eric Sammer: 7 posts James Seigel: 7 posts Biblio84: 6 posts Harsh J: 6 posts
show more