Search Discussions

15 discussions - 30 posts

  • Hello guys, I am a newbie of Hadoop and doing an experiment with Hadoop. My situation is: +My job is expected to run continuously/frequently +My reduce task require a large amount of configuration ...
    Fan wei fangFan wei fang
    Aug 24, 2009 at 3:47 am
    Aug 27, 2009 at 3:24 am
  • Does hadoop have the capability of merging multiple mappers(on the same node) output into a single one, to speed up the shuffling phase? Is there a JIRA that I can find more information about it? ...
    Zheng ShaoZheng Shao
    Aug 16, 2009 at 2:01 am
    Aug 17, 2009 at 8:56 pm
  • Hi everyone, I've come across a problem running Map/Reduce on an EC2 cluster, and was wondering if anyone here had any thoughts to what the issue was. I'm running a simple 'sort' M/R job on 40GB from ...
    George PorterGeorge Porter
    Aug 17, 2009 at 6:53 pm
    Aug 17, 2009 at 7:43 pm
  • http://www.hadooper.cn/hadoop/cgi-bin/moin.cgi/thirdcfp Time : Sunday, November 15, 2009 City: Beijing, China Sponsored by Yahoo!, Cloudera Organized by hadooper.cn Website: ...
    He YongqiangHe Yongqiang
    Aug 21, 2009 at 4:22 pm
    Aug 21, 2009 at 4:34 pm
  • I'm looking at hadoop 0.18 vs 0.20. Why doesn't Partitioner have a setup(JobContext) method ? It seem before it used to be a JobConfigurable. Parameters can be passed statically by the Mapper but ...
    Julien Le DemJulien Le Dem
    Aug 13, 2009 at 5:25 pm
    Aug 14, 2009 at 4:31 pm
  • Hi all, currently, we try to upgrade from hadoop-0.19 to hadoop-0.20. Therefore, we try to get rid of the deprecated JobConf class and switch to org.apache.hadoop.mapreduce.Job where possible. In ...
    Thomas ThevisThomas Thevis
    Aug 12, 2009 at 9:56 am
    Aug 13, 2009 at 1:26 pm
  • Hi... I was reading the HDFS code, and I can't find a way to read the replicated blocks of a block-file. DFS.getFileBlockLocations returns all blocks of a file File = block-a, block-b, ..... block-n. ...
    Harold Valdivia GarciaHarold Valdivia Garcia
    Aug 6, 2009 at 8:20 pm
    Aug 7, 2009 at 12:14 am
  • (moved to mapreduce-user) Hey Deepak, There's a slightly dated blog post from Aaron Kimball about how to use DBInputFormat to run a Hadoop MapReduce job over records stored in a database: ...
    Jeff HammerbacherJeff Hammerbacher
    Aug 30, 2009 at 10:04 pm
    Aug 30, 2009 at 10:04 pm
  • I think I am missing something big. But, I can't figure out how to migrate to Mapreduce 0.20.0. Here's what I think I know: - The org.apache.hadoop.mapred.* classes are deprecated -- so we shouldn't ...
    Sean OwenSean Owen
    Aug 29, 2009 at 10:21 am
    Aug 29, 2009 at 10:21 am
  • Hi, My name is Jay from Korea. While running Hadoop cluster with version 0.18.3, I added several machines to the cluster a few days ago. Legacy machines have 2 CPU and 8 GB memories, I set ...
    Bae, Jae HyeonBae, Jae Hyeon
    Aug 27, 2009 at 3:34 am
    Aug 27, 2009 at 3:34 am
  • Hey all, Has anyone seen behavior where the number of reduce input records is significantly larger than the number of map output records? There's no combiner involved in the job at hand, and it's not ...
    Todd LipconTodd Lipcon
    Aug 14, 2009 at 6:53 am
    Aug 14, 2009 at 6:53 am
  • Hi, everyone. How can I split the cluster in subcluster?. I want to break my cluster in regions, for example I'd like to have a region for only sorting, other for only joins, other for only groupby, ...
    Harold Valdivia GarciaHarold Valdivia Garcia
    Aug 6, 2009 at 3:38 pm
    Aug 6, 2009 at 3:38 pm
  • Hi, Edward J. Yoon Sorry that I found I was not in hama-user maillist. Just joined[?] Xrime is based on Map/Reduce using HDFS to store graph information. It is distributed and parallel. We will ...
    Bin CaiBin Cai
    Aug 5, 2009 at 3:05 am
    Aug 5, 2009 at 3:05 am
  • Hi all, I'm looking for a way to invoke a Hadoop Job programmatically. Is there any sort of an interface for submitting Jobs to Hadoop besides just the command line or some sort of intermediate file ...
    Aug 4, 2009 at 3:04 pm
    Aug 4, 2009 at 3:04 pm
  • Hi, I have a problem trying to customize the key-value seperator of the reducer output: My Hadoop version: 0.19.2 I'm trying to get the reducer to use ctrl-A to seperate key value pairs. ...
    Aug 1, 2009 at 1:53 am
    Aug 1, 2009 at 1:53 am
Group Navigation
period‹ prev | Aug 2009 | next ›
Group Overview
groupmapreduce-user @