[Hadoop-common-user] sort speeds under java, c++, and streaming

	Owen O'Malley
	Nov 9, 2007 at 3:02 am

On Nov 8, 2007, at 5:35 PM, Joydeep Sen Sarma wrote:

Doesn't the sorting and merging all still happen in Java-land?

Yes, that is why it surprised me.

-- Owen

Search Discussions

Owen O'Malley: Sure, I guess I should have been more specific to start with. *grin* The data was generated with: bin/hadoop jar hadoop-0.15.0-dev-examples.jar randomtextwriter -conf gridmix-text.xml\ -outFormat org.apache.hadoop.mapred.TextOutputFormat /gridmix/ data/sort/text contents of gridmix-text.xml: <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?> test.randomtextwrite.total_bytes 429496729600 test.randomtextwrite.min_words_key 1 test.randomtextwrite.max_words_key 10

Follow ups

Discussion Navigation

view	thread \| post
posts	‹ prev \| 7 of 14 \| next ›

Discussion Overview

font	variable	Hotkey: f
user style	avatars	Hotkey: a