FAQ

Hadoop > common-user > August 2011

Search Discussions

129 discussions - 474 posts

  • I'm running Hadoop 0.20.203.0 with the default io.compression.codec value. When I try to do "hadoop fs -text" on a "*.deflate" file on HDFS it prints garbage to STDOUT. Presumably the file is not ...
    W.P. McNeillW.P. McNeill
    Aug 31, 2011 at 11:49 pm
    Aug 31, 2011 at 11:49 pm
  • Hi ! I wanted to build and run the hadoop code itself from eclipse . I followed the instructions in http://wiki.apache.org/hadoop/EclipseEnvironment as : 1) I have checked out the hadoop release from ...
    Arun kArun k
    Aug 31, 2011 at 6:10 am
    Aug 31, 2011 at 6:10 am
  • Hi - I’m working with Maven inside IntelliJ, using Hadoop 0.20.203.0, and I get the following error message when trying to run my own unit tests, that use MiniDFSCluster. I copied how to use ...
    Frank AstierFrank Astier
    Aug 29, 2011 at 7:01 pm
    Aug 29, 2011 at 7:01 pm
  • Hi, We are organizing a Hadoop meetup to talk about Hadoop and big data in Delhi/NCR. We have good presenters from different organizations and the topic looks very interesting. Suggestions and ...
    Shahnawaz SaifiShahnawaz Saifi
    Aug 24, 2011 at 5:19 pm
    Aug 24, 2011 at 5:19 pm
  • Hi, I am newbie in Python I was looking in to the Python example of running map reduce job of Michael Noll's article. I was trying to run this example in CDH3. Map tasks is running in a loop and the ...
    Jagaran dasJagaran das
    Aug 23, 2011 at 9:20 pm
    Aug 23, 2011 at 9:20 pm
  • Hadoop fans, The September Hadoop meetup will be held Wednesday, September 14, from 6pm to 8pm. This meetup will be hosted by ngmoco at their office on Brannan St. As usual, we will use the ...
    Aaron KimballAaron Kimball
    Aug 22, 2011 at 9:35 pm
    Aug 22, 2011 at 9:35 pm
  • Hi all, I would like to force locality for the tasks in hadoop using FairScheduler and schedule the tasks locally than on non-local nodes. I am using CDH3 and tried setting the property in ...
    ASNASN
    Aug 22, 2011 at 12:43 pm
    Aug 22, 2011 at 12:43 pm
  • Hey to everyone! ;) Anyone knows, how do I pass null or empty -param through to pig script? Following *does not* work: /pig/bin/pig -param *rootPath=* MapProfile.pig /pig/bin/pig -param *rootPath=''* ...
    MarcelloMarcello
    Aug 22, 2011 at 12:41 pm
    Aug 22, 2011 at 12:41 pm
  • Hi I just upgraded from 0.19 to 0.20 everything seems fine however the web monitoring tool doesn't work any more: neither http://mydomain.com:50070/webapps/hdfs/dfshealth.jsp nore ...
    MilleBiiMilleBii
    Aug 21, 2011 at 6:04 pm
    Aug 21, 2011 at 6:04 pm
  • http://on.fb.me/p7Og4F -- Thanks, Shah
    Shahnawaz SaifiShahnawaz Saifi
    Aug 20, 2011 at 2:49 pm
    Aug 20, 2011 at 2:49 pm
  • I would like my streaming job to receive the names of files stored on HDFS, but not the actual contents of the files, and I would like data locality to be honored (I want mappers to run on nodes ...
    Keith WileyKeith Wiley
    Aug 19, 2011 at 9:46 pm
    Aug 19, 2011 at 9:46 pm
  • I am working with some data that has a custom IO serialization. So I've added the appropriate class to the io.serializations property of mapred-site.xml. <property <name io.serializations</name ...
    W.P. McNeillW.P. McNeill
    Aug 17, 2011 at 8:48 pm
    Aug 17, 2011 at 8:48 pm
  • Hi all, Is it possible to use HFTP input like this: $ hadoop jar hadoop-streaming.jar \ - -input hftp://node1/records \ - -output hdfs://node2/result ... ? I've tried several times with different ...
    Chenguang LiChenguang Li
    Aug 16, 2011 at 10:21 am
    Aug 16, 2011 at 10:21 am
  • Hi all, There was a modified version of one of the tests I wanted to use. I dropped its source into {HADOOP}/src/test/org/apache/hadoop/fs, and I modified ...
    Sean HoganSean Hogan
    Aug 15, 2011 at 4:18 pm
    Aug 15, 2011 at 4:18 pm
  • Hey guys, I'm new on the list and I'm currently considering Hadoop to solve a data distribution problem. Right now, there's a server which contains very large files (usual files have 30GB or even ...
    Thiago MoraesThiago Moraes
    Aug 15, 2011 at 12:39 am
    Aug 15, 2011 at 12:39 am
  • Hello all, I was hoping to get some feedback on a new API that I have been working on for Hadoop as part of my MSc dissertation project. Then I thought who better to ask than the Hadoop users ...
    Cosmin DumitracheCosmin Dumitrache
    Aug 15, 2011 at 12:38 am
    Aug 15, 2011 at 12:38 am
  • Dear All: The job tracker and the web interface for the namenode and jobtracker displays various information about the jobs for both pseudo mode and cluser mode (which I am yet to setup, see my other ...
    A DfA Df
    Aug 13, 2011 at 11:58 am
    Aug 13, 2011 at 11:58 am
  • They have 2 values in the log, do they mean max and min? 2011-08-13 18:18:16,661 INFO org.apache.hadoop.mapred.MapTask: data buffer = 79691776/99614720 2011-08-13 18:18:16,661 INFO ...
    Daniel,WuDaniel,Wu
    Aug 13, 2011 at 10:22 am
    Aug 13, 2011 at 10:22 am
  • Hi, What is the best and fast way to achieve parallel copy to hadoop from an NFS mount? We have a mount with huge number of files and we need to copy it into hdfs. Some options: 1. Run copyFromLocal ...
    Jagaran dasJagaran das
    Aug 13, 2011 at 8:01 am
    Aug 13, 2011 at 8:01 am
  • I'm getting this "Incompatible buildVersion" error even though they look to be the same build version (see below). The only difference is that the tasktracker is running on Debian-6.0 and the ...
    Matt MatsonMatt Matson
    Aug 12, 2011 at 11:50 pm
    Aug 12, 2011 at 11:50 pm
  • Hey, If you are using Hadoop in Pittsburgh, please send me a quick note with a short description of what you are doing. I'm especially interested in companies using Hadoop. I run the local Pittsburgh ...
    Doug BalogDoug Balog
    Aug 11, 2011 at 3:29 pm
    Aug 11, 2011 at 3:29 pm
  • Hi, I found some materials about submitting hadoop jobs via PBS. Any idea how to interactively browse HDFS through PBS? Our supercomputer uses lustre storage system. I found a wiki talking about ...
    Shi YuShi Yu
    Aug 11, 2011 at 3:24 pm
    Aug 11, 2011 at 3:24 pm
  • Greetings all. I've been looking for documentation to answer a couple of hadoop configuration questions but so far have come up dry. I was hoping someone could provide a quick pointer or answer a ...
    Greg BledsoeGreg Bledsoe
    Aug 9, 2011 at 5:30 pm
    Aug 9, 2011 at 5:30 pm
  • Hi , I want to get result information of finished hadoop job. Currently I can see it using hadoop admin web console. For example: Kind% CompleteNum TasksPendingRunningCompleteKilledFailed/Killed Task ...
    Oleg RuchovetsOleg Ruchovets
    Aug 9, 2011 at 3:18 pm
    Aug 9, 2011 at 3:18 pm
  • Hi, According to the attached image found on yahoo's hadoop tutorial<http://developer.yahoo.com/hadoop/tutorial/module4.html , the order of operations is map combine partition which should be ...
    Premal ShahPremal Shah
    Aug 5, 2011 at 6:00 pm
    Aug 5, 2011 at 6:00 pm
  • According to the hadoop streaming docs<http://hadoop.apache.org/common/docs/r0.20.0/streaming.html#Working+with+the+Hadoop+Aggregate+Package+%28the+-reduce+aggregate+option%29 , there is an inbuilt ...
    Premal ShahPremal Shah
    Aug 4, 2011 at 8:35 pm
    Aug 4, 2011 at 8:35 pm
  • Hai all ! I am Masters graduate trying to use Mumak for my project. Case 1: I did svn checkout of common,hdfs and mapreduce from http://svn.apache.org/repos/asf/hadoop/common/trunk/ I inserted proxy ...
    Arun kArun k
    Aug 3, 2011 at 4:50 am
    Aug 3, 2011 at 4:50 am
  • Hello, we are currently trying to configure a secure Hadoop install (version 0.22) to work with a Checkpoint node, and the problem is that we can't seem to find any property that allows you to set ...
    Grzegorz GuniaGrzegorz Gunia
    Aug 2, 2011 at 11:00 pm
    Aug 2, 2011 at 11:00 pm
  • Hi Hadoop users, Zinnia Systems is conducting one day workshop on Hadoop in Bangalore. If anyone interested register here http://hadoopworkshop.eventbrite.com/ Regards, Madhukara Phatak
    Madhu phatakMadhu phatak
    Aug 2, 2011 at 12:05 pm
    Aug 2, 2011 at 12:05 pm
Aug 2011
123
Group Navigation
period‹ prev | Aug 2011 | next ›
Group Overview
groupcommon-user @
categorieshadoop
discussions129
posts474
users165
websitehadoop.apache.org...
irc#hadoop

165 users for August 2011

Harsh J: 36 posts A Df: 14 posts W.P. McNeill: 14 posts Allen Wittenauer: 13 posts Jagaran das: 12 posts John Armstrong: 12 posts Daniel,Wu: 10 posts Michel Segel: 10 posts Shanmuganathan.r: 10 posts אבי ווקנין: 10 posts GOEKE, MATTHEW (AG/1000): 9 posts Joey Echeverria: 9 posts Steve Loughran: 9 posts Keith Wiley: 8 posts Stan Rosenberg: 8 posts Kai Voigt: 7 posts Shahnawaz Saifi: 7 posts Jianxin Wang: 6 posts Madhu phatak: 6 posts Adi: 5 posts
show more
Archives