FAQ
Hi All

Is there any heuristic to figuring out as to how many map/reduce tasks I
need to be running ? For eg if I am processing a file that is 100GB how many
map/reduce tasks do I need to run ?

Thanks
A

Search Discussions

  • Enis Soztutar at May 30, 2007 at 12:53 pm

    Avinash Lakshman wrote:
    Hi All

    Is there any heuristic to figuring out as to how many map/reduce tasks I
    need to be running ? For eg if I am processing a file that is 100GB how many
    map/reduce tasks do I need to run ?

    Thanks
    A

    you can just check out the wiki page :
    http://wiki.apache.org/lucene-hadoop/HowManyMapsAndReduces

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedMay 29, '07 at 11:44p
activeMay 30, '07 at 12:53p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Enis Soztutar: 1 post Avinash Lakshman: 1 post

People

Translate

site design / logo © 2022 Grokbase