FAQ
Tests of S3--EC2 transfer speed using curl have shown that gigabit
ethernet speeds can be reached between nodes but only when multiple
transfers are overlapped. See:
http://info.rightscale.com/2007/11/29/network-performance-in-ec2-and-s3

- Aaron

Toby DiPasquale wrote:
On Sat, Mar 1, 2008 at 4:19 PM, Bradford Stephens
wrote:
What sort of performance hit is there for using S3 vs. a local cluster?
In my experience on EC2 using Hadoop, S3-backed HDFS is 25-33% slower
than disk-backed HDFS. That was using 0.14.x, however, so it might be
better now...

Search Discussions

Discussion Posts

Previous

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 8 of 12 | next ›
Discussion Overview
groupcommon-user @
categorieshadoop
postedMar 1, '08 at 5:11p
activeMar 2, '08 at 6:38p
posts12
users6
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase