FAQ

Search Discussions

129 discussions - 474 posts

  • ----------------------------------------------------------------------- Senthil wants to stay in better touch using some of Google's coolest new products. If you already have Gmail or Google Talk, ...
    SenthilSenthil
    Aug 27, 2011 at 4:06 am
    Aug 27, 2011 at 10:07 pm
  • Using hadoop 0.20.203.0 single node setup root directory is writable for everybody despite I've set it's mode to 755 and then even 000 (verified using -ls) What could be the problem? Best regards, -- ...
    Stanislaw AdaszewskiStanislaw Adaszewski
    Aug 26, 2011 at 4:13 pm
    Aug 26, 2011 at 4:56 pm
  • Hi All, The following patches in the https://issues.apache.org/jira/browse/HDFS-976 link are belongs to which Version of hadoop ? 0001-0.20.3_rc2-AvatarNode.patch AvatarNode.20.patch Thanks in ...
    Shanmuganathan.rShanmuganathan.r
    Aug 26, 2011 at 9:17 am
    Aug 26, 2011 at 10:50 am
  • Hello guys, I am looking to use MultipleInputs.addInputPath() method in hadoop 0.20.2. But when I am looking to its signature in the API, its like this : * public static void addInputPath(JobConf ...
    Praveenesh kumarPraveenesh kumar
    Aug 24, 2011 at 9:11 am
    Aug 26, 2011 at 10:43 am
  • For those of you who has the book, on page 49 there is a custom partitioner example. It basically describes a situation where the map emits <K,V , but the key is a compound key like (K1,K2), and we ...
    Mehmet TepedelenliogluMehmet Tepedelenlioglu
    Aug 23, 2011 at 11:26 pm
    Aug 24, 2011 at 12:10 am
  • Anyone had worked on Hadoop data integration with SAS? Does SAS have a connector to HDFS? Can it use data directly on HDFS? Any link or samples or tools? Thanks! Jonathan This message is for the ...
    Jonathan HwangJonathan Hwang
    Aug 23, 2011 at 9:22 pm
    Aug 23, 2011 at 9:51 pm
  • Hadoop developers, Arun will be cutting a branch for Hadoop 0.23 as soon the trunk has a successful build. I'd like Hoop (https://issues.apache.org/jira/browse/HDFS-2178) to be part of 0.23 (Nicholas ...
    Alejandro AbdelnurAlejandro Abdelnur
    Aug 22, 2011 at 9:18 pm
    Aug 22, 2011 at 11:10 pm
  • Hello, I'm playing around with the Capacity Scheduler (coming from the Fair Scheduler), and it appears that a queue with jobs submitted by the same user are treated as FIFO. So, for example, if I ...
    Matt DaviesMatt Davies
    Aug 17, 2011 at 5:56 pm
    Aug 22, 2011 at 4:17 am
  • Hello all, I have a Hadoop related application that is integrated with HDFS and is started via the command line with "hadoop jar ..." The amount of data used by the application changes from use case ...
    Adam ShookAdam Shook
    Aug 19, 2011 at 3:35 pm
    Aug 19, 2011 at 4:20 pm
  • Hi all, I've been seeing an HDFS issue I don't understand, and I'm hoping someone else has seen this before. I'm currently attempting to set up a simple-stupid Hadoop 0.20.203.0 test cluster on two ...
    Adam DeConinckAdam DeConinck
    Aug 16, 2011 at 7:49 pm
    Aug 19, 2011 at 2:06 am
  • We have a version mismatch problem which may be Hadoop related but may be due to a third party product we are using that requires us to run Zookeeper and Hadoop. This product is rumored to soon be an ...
    Ratner, Alan S (IS)Ratner, Alan S (IS)
    Aug 18, 2011 at 12:15 pm
    Aug 18, 2011 at 8:27 pm
  • I have a large number of gzipped web server logs on NFS that I need to pull into HDFS for analysis by MapReduce. What is the most efficient way to do this? It seems like what I should do is: hadoop ...
    W.P. McNeillW.P. McNeill
    Aug 12, 2011 at 5:29 pm
    Aug 15, 2011 at 9:18 pm
  • I am getting this error with a mostly out of the box configuration from version 0.20.203.0 When I try to run the wordcount examples. $ hadoop jar hadoop-examples-0.20.203.0.jar wordcount ...
    Brown, Berlin [GCG-PFS]Brown, Berlin [GCG-PFS]
    Aug 12, 2011 at 7:50 pm
    Aug 13, 2011 at 6:45 pm
  • Hi, Would someone please explain why ReduceContext.nextKeyValue() creates only a single instance of the deserializing class? This is a rather non-standard semantics for deserialization and drove me ...
    Stan RosenbergStan Rosenberg
    Aug 11, 2011 at 3:46 am
    Aug 13, 2011 at 2:57 pm
  • Hello Mates: Thanks to everyone for their help so far. I have learnt a lot and have now done single and pseudo mode. I have a hadoop cluster but I ran jps on the master node and slave node but not ...
    A DfA Df
    Aug 12, 2011 at 11:19 pm
    Aug 13, 2011 at 3:07 am
  • Is it possible to pass command line arguments to streaming scripts? eg: python mapper.py --match=2 can i pass match=2 using a streaming command to mapper.py? -- Regards, Premal Shah.
    Premal ShahPremal Shah
    Aug 10, 2011 at 8:08 pm
    Aug 10, 2011 at 9:01 pm
  • Looks like I have something not configured particularly well so that mapred/local/taskTracker/archive is a local filesystem and its filling things up. Is it ok to delete ...
    Robert J BergerRobert J Berger
    Aug 9, 2011 at 8:35 am
    Aug 9, 2011 at 4:58 pm
  • Hi, I have been struck with this exception: java.io.IOException: config() at org.apache.hadoop.conf.Configuration.(Configuration.java:211) at ...
    Jagaran dasJagaran das
    Aug 6, 2011 at 3:23 am
    Aug 6, 2011 at 7:17 am
  • Hi, Anyone working on YCSB (Yahoo Cloud Service Benchmarking) for HBase ?? I am trying to run it, its giving me error: $ java -cp build/ycsb.jar com.yahoo.ycsb.CommandLine -db ...
    Praveenesh kumarPraveenesh kumar
    Aug 3, 2011 at 10:12 am
    Aug 4, 2011 at 2:08 pm
  • Hello all, We are trying to split up a large XML file into chunks of even elements. To be specific, we have a very large file with a root element and a few large <doc </doc elements. The goal is to ...
    CrookeddyCrookeddy
    Aug 2, 2011 at 9:53 pm
    Aug 3, 2011 at 5:13 am
  • Hi, I want to give my users a GUI that would allow them to start Hadoop clusters and run applications that I will provide on the AMIs. What would be a good approach to make it simple for the user? ...
    Mark KerznerMark Kerzner
    Aug 2, 2011 at 4:10 am
    Aug 2, 2011 at 5:19 pm
  • Hello, I found pig-0.8.1 included classes of Hbase-0.90.0. My question is: 1. If I replace Hbase-0.90.3 with Hbase-0.90.0, could pig-0.8.1 work normally? 2. why Hbase class files are included in ...
    Lulynn_2008Lulynn_2008
    Aug 7, 2011 at 10:04 pm
    Jun 12, 2012 at 1:22 am
  • Hi all ! How are you? My name is Ronen and I have been fascinated by Apache Hadoop for the last few months. I am spending the last two weeks trying to optimize my configuration files and environment. ...
    אבי ווקניןאבי ווקנין
    Aug 18, 2011 at 8:00 am
    Feb 11, 2012 at 7:59 pm
  • Is it possible to turn off all the Hadoop logs simultaneously? In my unit tests, I don’t want to see the myriad “INFO” logs spewed out by various Hadoop components. I’m using: ((Log4JLogger) ...
    Frank AstierFrank Astier
    Aug 29, 2011 at 7:32 pm
    Sep 1, 2011 at 9:54 am
  • Hi All, First, I really enjoy writing you and I'm thankful for your help. I have Oozie installed on dedicated server and I want to monitor it using my Nagios server. Can you please suggest some ...
    Avi VakninAvi Vaknin
    Aug 30, 2011 at 9:29 am
    Aug 30, 2011 at 1:10 pm
  • Hi all, I'm running Hadoop on a single node mode in SLES 10 and everything ran smoothly for about a week until 3 days ago, where for no reason the web ui 404's for every daemon. Hadoop runs with no ...
    Joao pedro canilhoJoao pedro canilho
    Aug 30, 2011 at 12:07 pm
    Aug 30, 2011 at 12:08 pm
  • Ok, this is a first, but we're to see if we can do a simulcast by broadcasting the meeting live over LiveMeeting. This month's meeting: A tale of two derivatives features Ted Dunning of MapR and ...
    Michael SegelMichael Segel
    Aug 30, 2011 at 2:55 am
    Aug 30, 2011 at 3:11 am
  • Hi, I know this question has been asked before, but I could not find the right solution. Maybe because I use hadoop 0.20.2, some posts assumed older versions. My code (relevant chunk): import ...
    Dieter PlaetinckDieter Plaetinck
    Aug 26, 2011 at 3:41 pm
    Aug 29, 2011 at 5:04 am
  • How do i take a machine down that is a datanode without causing the namenode to start fixing the under-replication? Say i need to fix something on the machine that will take 30 mins, and after that i ...
    Koert KuipersKoert Kuipers
    Aug 27, 2011 at 11:05 pm
    Aug 28, 2011 at 2:19 am
  • Does anyone have any experience using HP Proliant SL hardware for hadoop? We are currently using DL 160 and DL 180 servers, and the SL hardware seems to fit the bill for our new servers in many ways. ...
    Koert KuipersKoert Kuipers
    Aug 24, 2011 at 2:43 pm
    Aug 24, 2011 at 6:23 pm
  • Hi All, I have some query regarding task re-scheduling.Can it possible to make Job tracker wait for some time before re-scheduling of failed tracker's tasks. Thanks and regards, Vaibhav Pol National ...
    Vaibhav PolVaibhav Pol
    Aug 23, 2011 at 9:44 am
    Aug 23, 2011 at 2:53 pm
  • Hi, http://wiki.apache.org/hadoop/HowToContribute is a great resource detailing the steps needed to build jars and tars from the source code. However, I am still not sure what the best way to run ...
    Ravi PrakashRavi Prakash
    Aug 18, 2011 at 9:19 pm
    Aug 23, 2011 at 12:32 am
  • 发送自 HTC ----- Reply message ----- 发件人: "lulynn_2008" <lulynn_2008@163.com 收件人: "user@pig.apache.org" <user@pig.apache.org , "common-user@hadoop.apache.org" <common-user@hadoop.apache.org 主题: Can ...
    ShijuweiShijuwei
    Aug 22, 2011 at 12:02 pm
    Aug 22, 2011 at 7:46 pm
  • Hi. I'm running a 2 Node Hadoop (v 20.203). I'm trying to do a distributed image processing. And now, I'm facing an issue, The job it's a Hadoop pipes job, with custom RecordReader, Maper and Reducer ...
    Xian BoullosaXian Boullosa
    Aug 22, 2011 at 2:23 pm
    Aug 22, 2011 at 3:48 pm
  • hi everyone, i have a few hadoop streaming tasks that would benefit from having the reduce phase execute one reducer per node instead of two per node due to high cpu and i/o. currently, i have a 30 ...
    Steven HafranSteven Hafran
    Aug 17, 2011 at 7:37 am
    Aug 22, 2011 at 4:19 am
  • Hi All, Recently I was working with the CompositeInputFormat for MapSide Join and then tried MultipleInputs for ReduceSide join. The problem I found out was that both of these methods needed you to ...
    Varad MeruVarad Meru
    Aug 13, 2011 at 3:07 am
    Aug 21, 2011 at 1:35 pm
  • Hello. I have an idea which is to run the common java application(in the form of jar) on hadoop framework.Is there anyone to tell me whether it till be implemented and which subproject should I use ...
    HYHY
    Aug 18, 2011 at 12:52 pm
    Aug 18, 2011 at 1:55 pm
  • Hey all, I'd like to announce the inaugural meetup of the Indianapolis Hadoop User Group (IndyHUG), which will take place on August 23 at ChaCha Search Inc. The initial topic of discussion will be an ...
    Mark StetzerMark Stetzer
    Aug 18, 2011 at 3:05 am
    Aug 18, 2011 at 3:05 am
  • Please disregard my earlier email. I accidentally sent it before I was done writing. I am working with some data that has a custom IO serialization. So I've added a MySerialization class to the ...
    W.P. McNeillW.P. McNeill
    Aug 17, 2011 at 8:55 pm
    Aug 18, 2011 at 1:34 am
  • I am trying to figure out how to set the number of maps to use in 0.20.2. If I was using JobConf in my program I could use: conf.setNumMapTasks(numMaps); However JobConf and the method are deprecated ...
    Jason ReedJason Reed
    Aug 14, 2011 at 8:51 pm
    Aug 16, 2011 at 5:04 am
  • hi,all! well all knows that bloksize and filesplit control the number of mappers(in hadoop-0.20.2). But when using the HBASE as input, how is the number of mappers decided? thanks a lot! Shuai Zhang
    Zhangshuai01Zhangshuai01
    Aug 15, 2011 at 5:28 pm
    Aug 15, 2011 at 5:49 pm
  • I am using CDH3 update1 hadoop 0.20.2, the cluster is composed of 9 nodes(1NN + 8 (DN and TT)) , I found that it's very slow to submit job to the jobtracker (using hive or hadoop jar command) when ...
    AirAir
    Aug 12, 2011 at 7:46 am
    Aug 12, 2011 at 7:46 am
  • I know you can do something like this: -cmdenv LD_LIBRARY_PATH=./my_libs if you have shared libraries in a subdirectory under the cwd (such as occurs when using -cacheArchive to load and unpack a jar ...
    Keith WileyKeith Wiley
    Aug 5, 2011 at 6:37 pm
    Aug 10, 2011 at 8:04 pm
  • Hello, I found pig-0.8.1 included junit-4.5 class files. Could you please give me some suggestion my questions : Can pig-0.8.1 can work with junit 4.3.1 or 4.8.1 or 4.8.2? why included classes in ...
    Lulynn_2008Lulynn_2008
    Aug 7, 2011 at 10:03 pm
    Aug 8, 2011 at 9:47 pm
  • Does anyone have some workarounds I can try for "Slow generation of blockReport at DataNode causes delay of sending heartbeat to NameNode"? I see it is closed JIRA ...
    Joe SteinJoe Stein
    Aug 6, 2011 at 9:24 pm
    Aug 7, 2011 at 3:49 pm
  • Hi, Please suggest what would be the best way to profile NameNode? Any specific tools. We would streaming transaction data using around 2000 threads concurrently to NameNode continuously. Size is ...
    Jagaran dasJagaran das
    Aug 7, 2011 at 5:42 am
    Aug 7, 2011 at 3:39 pm
  • According to the attached image found on yahoo's hadoop tutorial, the order of operations is map combine partition which should be followed by reduce Here is my an example key emmited by the map ...
    PremalPremal
    Aug 5, 2011 at 10:35 pm
    Aug 6, 2011 at 3:51 am
  • I have just started to explore Hadoop but I am stuck in a situation now. I want to run a MapReduce job in hadoop which needs to create a "setup" folder in working directory. During the execution the ...
    Shrish BajpaiShrish Bajpai
    Aug 2, 2011 at 12:24 am
    Aug 3, 2011 at 11:48 am
  • should they matched exactly?
    Daniel,WuDaniel,Wu
    Aug 3, 2011 at 3:06 am
    Aug 3, 2011 at 5:11 am
  • Hi, I am using hive-hbase-handler-0.7.0-cdh3u0.jar (under hive-0.7.0-cdh3u0/lib) thrift-fb303-0.5.0.jar (under hive-0.7.0-cdh3u0/lib) thrift-0.2.0.jar (under hbase-0.90.1-cdh3u0/lib) in my project. ...
    Neerja BhatnagarNeerja Bhatnagar
    Aug 2, 2011 at 1:30 am
    Aug 2, 2011 at 1:39 am
Group Navigation
period‹ prev | Aug 2011 | next ›
Group Overview
groupcommon-user @
categorieshadoop
discussions129
posts474
users165
websitehadoop.apache.org...
irc#hadoop

165 users for August 2011

Harsh J: 36 posts A Df: 14 posts W.P. McNeill: 14 posts Allen Wittenauer: 13 posts Jagaran das: 12 posts John Armstrong: 12 posts Daniel,Wu: 10 posts Michel Segel: 10 posts Shanmuganathan.r: 10 posts אבי ווקנין: 10 posts GOEKE, MATTHEW (AG/1000): 9 posts Joey Echeverria: 9 posts Steve Loughran: 9 posts Keith Wiley: 8 posts Stan Rosenberg: 8 posts Kai Voigt: 7 posts Shahnawaz Saifi: 7 posts Jianxin Wang: 6 posts Madhu phatak: 6 posts Adi: 5 posts
show more