FAQ
ReflectionUtils.setConf would configure the KeyFieldBasedPartitioner twice in Hadoop 0.21.0, when KeyFieldBasedPartitioner is an Configurable instance
------------------------------------------------------------------------------------------------------------------------------------------------------

Key: HADOOP-7425
URL: https://issues.apache.org/jira/browse/HADOOP-7425
Project: Hadoop Common
Issue Type: Bug
Components: util
Affects Versions: 0.21.0
Reporter: steven zhuang


In the setConf method of org.apache.hadoop.util.ReflectionUtils, any instance of Configurable would be configured twice.
In 0.21.0, KeyFieldBasedPartitioner implements the Configurable interface. When configured twice, it get two KeyDescription and gives out wrong partition number.


public static void setConf(Object theObject, Configuration conf) {
if (conf != null) {
if (theObject instanceof Configurable) {
((Configurable) theObject).setConf(conf);
}
setJobConf(theObject, conf);
}
}


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJun 24, '11 at 2:06a
activeJun 24, '11 at 2:06a
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

steven zhuang (JIRA): 1 post

People

Translate

site design / logo © 2023 Grokbase