Would anybody help me?
Can I use
-jobconf mapred.map.task=50 in streaming command to change the job's number of mappers?
I don't have a hadoop at hand and can not verify it. Thanks for your help.
--- On Wed, 10/15/08, Steve Gao wrote:
From: Steve Gao <email@example.com>
Subject: How to change number of mappers in Hadoop streaming?
Date: Wednesday, October 15, 2008, 7:25 PM
Is there a way to change number of mappers in Hadoop streaming command line?
I know I can change hadoop-default.xml:
<description>The default number of map tasks per job. Typically set
to a prime several times greater than number of available hosts.
Ignored when mapred.job.tracker is "local".
But that's for all jobs. What if I just want each job has different
NUM_OF_Mappers themselves? Thanks