FAQ
Hi,

I am trying to setup CDH4 on a Ubuntu server on EC2. The default login
process is via the SSH keys provided by Amazon. The account has
password-less access to sudo.

But when I reach the stage of providing the keys for CDH to install
the hadoop services I am kind of lost. Is there a how to for EC2?
Which key pair should I use? I tried the pem file that I use for SSH
login. Didn't work. Split it up using PuttyGen, didn't work. Created a
new rsa Key-Pair didn't work. Each time I get Exhausted Authentication
Options. Or and error mentioning 'unkown provider'.

What's the fastest way around this? Is it a CDH4 related issue? I can
try CDH3 if required.

Thanks and Regards,
skm.

Search Discussions

  • SKM at Jun 25, 2012 at 6:37 pm
    Oh, one more thing, I am new to EC2 environment, is setting up Elastic
    IP a pre-requisite for CDH Manager setup to succeed? I haven't got one
    setup yet.

    Thanks,
    Sumit.
    On Jun 25, 11:36 pm, SKM wrote:
    Hi,

    I am trying to setup CDH4 on a Ubuntu server on EC2. The default login
    process is via the SSH keys provided by Amazon. The account has
    password-less access to sudo.

    But when I reach the stage of providing the keys for CDH to install
    the hadoop services I am kind of lost. Is there a how to for EC2?
    Which key pair should I use? I tried the pem file that I use for SSH
    login. Didn't work. Split it up using PuttyGen, didn't work. Created a
    new rsa Key-Pair didn't work. Each time I get Exhausted Authentication
    Options. Or and error mentioning 'unkown provider'.

    What's the fastest way around this? Is it a CDH4 related issue? I can
    try CDH3 if required.

    Thanks and Regards,
    skm.
  • JoeAtAmpliPhi at Jun 25, 2012 at 8:08 pm
    Shouldn't need Elastic IP to deploy, just use the Amazon hostname
    (click on the instance in the EC2 Dashboard). If that doesn't work,
    setting an Elastic IP is pretty trivial, just click on Elastic IP,
    Allocate New Address, Attach, and then select the machine. Not
    terrible, but not automatic, either.

    -Joe
    On Jun 25, 2:37 pm, SKM wrote:
    Oh, one more thing, I am new to EC2 environment, is setting up Elastic
    IP a pre-requisite for CDH Manager setup to succeed? I haven't got one
    setup yet.

    Thanks,
    Sumit.

    On Jun 25, 11:36 pm, SKM wrote:






    Hi,
    I am trying to setup CDH4 on a Ubuntu server on EC2. The default login
    process is via the SSH keys provided by Amazon. The account has
    password-less access to sudo.
    But when I reach the stage of providing the keys for CDH to install
    the hadoop services I am kind of lost. Is there a how to for EC2?
    Which key pair should I use? I tried the pem file that I use for SSH
    login. Didn't work. Split it up using PuttyGen, didn't work. Created a
    new rsa Key-Pair didn't work. Each time I get Exhausted Authentication
    Options. Or and error mentioning 'unkown provider'.
    What's the fastest way around this? Is it a CDH4 related issue? I can
    try CDH3 if required.
    Thanks and Regards,
    skm.
  • Nick Dimiduk at Jun 27, 2012 at 4:11 am
    It's not a very good idea to give up your AWS account pem file. I would
    generate a dedicated key for use within your cluster (using ssh-keygen).
    Once you create it, you'll need to ship it around to the cluster nodes
    manually. You can do that from the (bash) terminal using a loop similar to
    this:

    for host in ec2-{host-a,host-b,...}.compute-1.amazonaws.com ; do
    scp ~/.ssh/cloudera_manager_id{,.pub} "ubuntu@${host}":.ssh/
    ssh "ubuntu@${host}" "chmod a+r .ssh/cloudera_manager_id.pub && chmod
    0600 .ssh/cloudera_manager_id"
    ssh "ubuntu@${host}" "cat .ssh/cloudera_manager_id.pub >>
    .ssh/authorized_keys"
    done

    Then you can upload that keypair to CM from that setup screen.

    One gottcha: Be sure to give CM the internal hostnames of the nodes you
    want it to manage, otherwise, they won't pass the reverse-dns sniff-test.

    Good luck,
    -n
    On Mon, Jun 25, 2012 at 11:36 AM, SKM wrote:

    Hi,

    I am trying to setup CDH4 on a Ubuntu server on EC2. The default login
    process is via the SSH keys provided by Amazon. The account has
    password-less access to sudo.

    But when I reach the stage of providing the keys for CDH to install
    the hadoop services I am kind of lost. Is there a how to for EC2?
    Which key pair should I use? I tried the pem file that I use for SSH
    login. Didn't work. Split it up using PuttyGen, didn't work. Created a
    new rsa Key-Pair didn't work. Each time I get Exhausted Authentication
    Options. Or and error mentioning 'unkown provider'.

    What's the fastest way around this? Is it a CDH4 related issue? I can
    try CDH3 if required.

    Thanks and Regards,
    skm.
  • Ronak Jani at Dec 14, 2012 at 10:46 pm
    Hey,

    I'm also facing similar issue with my cloudera haddop installation for RHEL
    instance on EC2.

    I'm able to access instance using username, ppk file and Passphrase through
    ssh (Putty). But when i provide the same information in Cloudera Manager
    at the time of installation it gets error

    Installation failed. Failed to authenticate.

    Please suggest me what to do.

    Thanks in advance,
    Ronak.

    On Wednesday, June 27, 2012 9:40:44 AM UTC+5:30, Nick Dimiduk wrote:

    It's not a very good idea to give up your AWS account pem file. I would
    generate a dedicated key for use within your cluster (using ssh-keygen).
    Once you create it, you'll need to ship it around to the cluster nodes
    manually. You can do that from the (bash) terminal using a loop similar to
    this:

    for host in ec2-{host-a,host-b,...}.compute-1.amazonaws.com ; do
    scp ~/.ssh/cloudera_manager_id{,.pub} "ubuntu@${host}":.ssh/
    ssh "ubuntu@${host}" "chmod a+r .ssh/cloudera_manager_id.pub && chmod
    0600 .ssh/cloudera_manager_id"
    ssh "ubuntu@${host}" "cat .ssh/cloudera_manager_id.pub >>
    .ssh/authorized_keys"
    done

    Then you can upload that keypair to CM from that setup screen.

    One gottcha: Be sure to give CM the internal hostnames of the nodes you
    want it to manage, otherwise, they won't pass the reverse-dns sniff-test.

    Good luck,
    -n

    On Mon, Jun 25, 2012 at 11:36 AM, SKM <sumit...@gmail.com <javascript:>>wrote:
    Hi,

    I am trying to setup CDH4 on a Ubuntu server on EC2. The default login
    process is via the SSH keys provided by Amazon. The account has
    password-less access to sudo.

    But when I reach the stage of providing the keys for CDH to install
    the hadoop services I am kind of lost. Is there a how to for EC2?
    Which key pair should I use? I tried the pem file that I use for SSH
    login. Didn't work. Split it up using PuttyGen, didn't work. Created a
    new rsa Key-Pair didn't work. Each time I get Exhausted Authentication
    Options. Or and error mentioning 'unkown provider'.

    What's the fastest way around this? Is it a CDH4 related issue? I can
    try CDH3 if required.

    Thanks and Regards,
    skm.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedJun 25, '12 at 6:36p
activeDec 14, '12 at 10:46p
posts5
users4
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase