I'd recommend trying the hs1.8xlarge or cc2.8xlarge instances, depending on
your storage requirements. m2.4xlarge has relatively lower I/O compared to
the these two and cr1.8xlarge has relatively lower amount of storage
capacity. You'll end up paying a higher price for the SSD storage on the
cr1.8xlarge but won't get a good bang for your buck because of lower total
storage and the fact that HDFS doesn't leverage SSD performance
characteristics to justify the cost.
I'd recommend taking a look at the reference architecture
It's for production deployments of the Hadoop stack on AWS and might be a
useful read if you are looking at a deployment where performance and
security is important.
Hope this helps.
On Sat, Jan 25, 2014 at 11:02 PM, wrote:
We plan to setup a Impala cluster in AWS with 5 to 10 machines to evaluate
it. It suggests the following hardware requirements in Impala installation
Memory - 128 GB or more recommended, ideally 256 GB or more.
Storage - DataNodes with 12 or more disks each
So we may have to chose the following instance types:
But we cannot make the final decision, guys could you please share your
ideas on this, thanks.
To unsubscribe from this group and stop receiving emails from it, send an
email to email@example.com.
To unsubscribe from this group and stop receiving emails from it, send an email to firstname.lastname@example.org.