FAQ

Could someone throw some light as to how intuitively fixed-type slots in
Hadoop have a negative impact of cluster utilization as mentioned in Arun's
blog?
It's pretty simple: in the course of time, a real cluster with a mix of
job types and submission times will have periods of high map-slot usage
(with reduce-slots available), and vice versa. Being able to assign machine
resources to whatever kind of task needs them at any given time means you're
not wasting those resources.

In short: map- vs. reduce-slots is an artificial and unnecessary restriction.

Greg

Search Discussions

Discussion Posts

Previous

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 2 of 3 | next ›
Discussion Overview
groupcommon-dev @
categorieshadoop
postedMar 2, '11 at 1:34p
activeMar 3, '11 at 12:20a
posts3
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Bikash sharma: 2 posts Greg Roelofs: 1 post

People

Translate

site design / logo © 2022 Grokbase