[Hadoop-common-user] add priority to task

By 'tasks' you mean the various MapTask(s) that are launched by Hadoop
MapReduce? Or do you mean Jobs?

The former isn't possible AFAIK (and doesn't make real sense having,
please correct me if I'm wrong). For the latter you may look here for
the command to set a particular priority for the job:
http://hadoop.apache.org/common/docs/current/commands_manual.html#job

Also doable in the driver code, look at the JobConf API --
http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred/JobConf.html#setJobPriority(org.apache.hadoop.mapred.JobPriority)

On Mon, Jul 26, 2010 at 3:28 PM, saurabhsuman8989
wrote:

By By 'tasks' i mean different tasks under one job. When a Job is distributed
in different tasks , can i add prioroty to those tasks.

As harsh said, It is not possible to add priority dynamically to tasks after
they are scheduled.

On Tue, Aug 3, 2010 at 9:42 AM, saurabhsuman8989
wrote:

Hi,

On Tue, Aug 3, 2010 at 9:42 AM, saurabhsuman8989
wrote:
It would interesting to know why you want to do this. Can you please
explain your use case ?

Thanks
Hemanth

Hi
Actually i am using it for crawling. So there is a Job which trigger
crawling. There are thousands of sites.which are distributed as different
tasks. i want to give priority to some of the sites which are more
important.