FAQ
Is there a way to change number of mappers in Hadoop streaming command line?
I know I can change hadoop-default.xml:

<property>
<name>mapred.map.tasks</name>
<value>10</value>
<description>The default number of map tasks per job.  Typically set
to a prime several times greater than number of available hosts.
Ignored when mapred.job.tracker is "local".
</description>
</property>

But that's for all jobs. What if I just want each job has different NUM_OF_Mappers themselves? Thanks

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedOct 15, '08 at 11:25p
activeOct 15, '08 at 11:25p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Steve Gao: 1 post

People

Translate

site design / logo © 2022 Grokbase