FAQ
Implement limits on per-job JobConf, Counters, StatusReport, Split-Sizes
------------------------------------------------------------------------

Key: MAPREDUCE-1943
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1943
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Mahadev konar
Assignee: Mahadev konar
Fix For: 0.22.0


We have come across issues in production clusters wherein users abuse counters, statusreport messages and split sizes. One such case was when one of the users had 100 million counters. This leads to jobtracker going out of memory and being unresponsive. In this jira I am proposing to put sane limits on the status report length, the number of counters and the size of block locations returned by the input split.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmapreduce-dev @
categorieshadoop
postedJul 14, '10 at 9:14p
activeJul 14, '10 at 9:14p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Mahadev konar (JIRA): 1 post

People

Translate

site design / logo © 2022 Grokbase