|| at May 26, 2011 at 10:09 pm
No of Maps - It depends on what is the Total File Size / Block Size
No of Reducers - You can specify.
From: Mohit Anchlia <email@example.com>
Sent: Thu, 26 May, 2011 2:48:20 PM
Subject: No. of Map and reduce tasks
How can I tell how the map and reduce tasks were spread accross the
cluster? I looked at the jobtracker web page but can't find that info.
Also, can I specify how many map or reduce tasks I want to be launched?
From what I understand is that it's based on the number of input files
passed to hadoop. So if I have 4 files there will be 4 Map taks that
will be launced and reducer is dependent on the hashpartitioner.