FAQ
Hi all,

Each reduce task produces one part file in the DFS. Why the job tracker
does not merge them at the end of the job to produce only one file.
It seems to me that it could be better to process results.

I think there is certainly a reason for the actual behavior but I really
need to get results of my map reduce job in a single file. Maybe someone
can give me a clue to solve my problem.

Thanks for any help.

Thomas.

--
Thomas FRIOL
Développeur Eclipse / Eclipse Developer
Solutions & Technologies
ANYWARE TECHNOLOGIES
Tél : +33 (0)561 000 653
Portable : +33 (0)609 704 810
Fax : +33 (0)561 005 146
www.anyware-tech.com

Search Discussions

Discussion Posts

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 1 of 2 | next ›
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJul 19, '06 at 1:06p
activeJul 19, '06 at 5:57p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase