Hi ,



I want my reducer output to be dumped into a csv file, How can that be
done?

Or can we convert part-000 to a csv ?



hadoop fs -cat /some/where/on/hdfs/job-output/part-* >
TheCombinedResultOfTheJob.csv

This doesn't work I get only the first column in csv file.



Regards,

Shreya Pal



This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful.

Search Discussions

  • Harsh J at Sep 16, 2011 at 11:41 am
    Shreya,

    Assuming your file output was already CSV (i.e. your job wrote it as so),
    you can get a merged file via:

    hadoop dfs -getmerge /some/dir/of/multiple/files mergedfile.csv
    On Fri, Sep 16, 2011 at 4:12 PM, wrote:

    Hi ,****

    ** **

    I want my reducer output to be dumped into a csv file, How can that be
    done? ****

    Or can we convert part-000 to a csv ?****

    ** **

    hadoop fs -cat /some/where/on/hdfs/job-output/part-* >
    TheCombinedResultOfTheJob.csv****

    This doesn’t work I get only the first column in csv file.****

    ** **

    Regards,****

    Shreya Pal****
    This e-mail and any files transmitted with it are for the sole use of the
    intended recipient(s) and may contain confidential and privileged
    information. If you are not the intended recipient(s), please reply to the
    sender and destroy all copies of the original message. Any unauthorized
    review, use, disclosure, dissemination, forwarding, printing or copying of
    this email, and/or any action taken in reliance on the contents of this
    e-mail is strictly prohibited and may be unlawful.


    --
    Harsh J

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmapreduce-user @
categorieshadoop
postedSep 16, '11 at 10:47a
activeSep 16, '11 at 11:41a
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Shreya Pal: 1 post Harsh J: 1 post

People

Translate

site design / logo © 2023 Grokbase