FAQ
Hi,
How is task slot in Hadoop defined with respect to scheduling a map/reduce
task on such slots available on TaskTrackers?

Thanks,
Bikash

Search Discussions

  • Allen Wittenauer at Mar 12, 2011 at 4:34 pm
    (Removing common-dev, because this isn't really a dev question)
    On Feb 25, 2011, at 5:52 AM, bikash sharma wrote:

    Hi,
    How is task slot in Hadoop defined with respect to scheduling a map/reduce
    task on such slots available on TaskTrackers?

    On a TaskTracker, one sets how many maps and reduces one wants to run on that node. The JobTracker is informed of this value. When a job is getting scheduled, it compares the various tasks's input to see if a DataNode is providing a matching block. If a block exists or is nearby, the task is scheduled on that node.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedFeb 25, '11 at 1:53p
activeMar 12, '11 at 4:34p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Allen Wittenauer: 1 post Bikash sharma: 1 post

People

Translate

site design / logo © 2022 Grokbase