FAQ
Is there anyway I can write out the results of my mapreduce job into 1
local file... ie the opposite of getmerge?

Thanks

Search Discussions

  • John Armstrong at Jul 5, 2011 at 3:18 pm

    On Tue, 05 Jul 2011 08:09:16 -0700, Mark wrote:
    Is there anyway I can write out the results of my mapreduce job into 1
    local file... ie the opposite of getmerge?
    I don't know about writing directly to the local filesystem, but if you
    specify a single reducer you should get only one output file, which your
    Tool can then copy to the local filesystem wherever you want it.
  • James Seigel at Jul 5, 2011 at 3:22 pm
    Single reducer.
    On 2011-07-05, at 9:09 AM, Mark wrote:

    Is there anyway I can write out the results of my mapreduce job into 1 local file... ie the opposite of getmerge?

    Thanks
  • Madhu phatak at Jul 27, 2011 at 10:57 am
    Always Map/Reduce jobs write to the HDFS. So you can use FS.copyToLocalFile
    API to copy the result into local systems
    On Tue, Jul 5, 2011 at 8:52 PM, James Seigel wrote:

    Single reducer.
    On 2011-07-05, at 9:09 AM, Mark wrote:

    Is there anyway I can write out the results of my mapreduce job into 1
    local file... ie the opposite of getmerge?
    Thanks

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedJul 5, '11 at 3:09p
activeJul 27, '11 at 10:57a
posts4
users4
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase