[MapReduce-user] Are the input values (associated with a specific key) of reduce() method sorted?

[MapReduce-user] Are the input values (associated with a specific key) of reduce() method sorted?

	James Y. Li
	Dec 6, 2011 at 12:55 am

Hi All,
I just begin to use Hadoop framework, and write my reduce() method. Wonder
if the Iterable input values (associated with the input key) are already
sorted. Thanks!

p.s. I am using the version 0.20.2-cdh3u1

-james

--
* <http://www.linkedin.com/in/jamesjamesli>*

Search Discussions

Discussion Posts

Follow ups

Joey Echeverria: Hi James, By default, there is no guarantees on value order. Using some of the more advanced API features, you can perform a secondary sort of values. You can read a good example of it here: http://sonerbalkir.blogspot.com/2010/01/simulating-secondary-sort-on-values.html -Joey -- Joseph Echeverria Cloudera, Inc. 443.305.9434
Harsh J: James, No, values do not come in any order for a given key. But it is achievable. If you need them to be ordered, you need to perform a secondary sort operation, by using multiple key components. See this 3-part series on how to do that, for example: http://www.cloudera.com/blog/2011/04/simple-moving-average-secondary-sort-and-mapreduce-part-3/

Related Discussions

Discussion Navigation

view	thread \| post
posts	‹ prev \| 1 of 3 \| next ›

Discussion Overview

group	mapreduce-user @
categories	hadoop
posted	Dec 6, '11 at 12:55a
active	Dec 6, '11 at 2:37a
posts	3
users	3
website	hadoop.apache.org...
irc	#hadoop

font	variable	Hotkey: f
user style	avatars	Hotkey: a

[MapReduce-user] Are the input values (associated with a specific key) of reduce() method sorted?

Search Discussions

Discussion Posts

Related Discussions

3 users in discussion