FAQ
Pankaj,

Another option would be to use the Cloudera Manager API along with Puppet
to setup your cluster.

Here's a blog post on how to use the CM API to setup a cluster
http://blog.cloudera.com/blog/2012/09/automating-your-cluster-with-cloudera-manager-api/


Thanks,
Bala
On Thu, Nov 15, 2012 at 11:44 AM, Pankaj Gupta wrote:

Hi,

I've been trying out CDH4 on a cluster on 6 machines and the experience
has been very good. Setting up and monitoring things with Cloudera Manager
has been seamless. I've primarily used HDFS and MR1 at this point and both
have worked perfectly. Next step for me is to set up a CDH cluster that is
integrated with the rest of cluster set up in my company which uses Puppet
to manage all machines.

What I need is, to be able to specify set up for each Hadoop machine using
Puppet manifests and use them to bring up the cluster and keep it in a
working state. It will be great if we could still use Cloudera Manger for
monitoring purposes but when we need to add new machines to the cluster, we
want to be able to set up the new machine using Puppet manifest too.

I would really appreciate suggestions on how to go about doing it.

Thanks in Advance,
Pankaj

--


Search Discussions

  • Philip Zeyliger at Nov 15, 2012 at 9:45 pm
    bcc:cdh-user

    To elaborate on this a bit further, we have several users installing the CM
    packages and CM config files using puppet, and then using the API to
    automate adding roles and hosts and what-not. See the "Path B
    Installation" guide for the manual steps to do the installer, which is
    basically what you'll be modelling in puppet.

    Cheers,

    -- Philip
    On Thu, Nov 15, 2012 at 1:42 PM, Bala Venkatrao wrote:

    Pankaj,

    Another option would be to use the Cloudera Manager API along with Puppet
    to setup your cluster.

    Here's a blog post on how to use the CM API to setup a cluster

    http://blog.cloudera.com/blog/2012/09/automating-your-cluster-with-cloudera-manager-api/


    Thanks,
    Bala
    On Thu, Nov 15, 2012 at 11:44 AM, Pankaj Gupta wrote:

    Hi,

    I've been trying out CDH4 on a cluster on 6 machines and the experience
    has been very good. Setting up and monitoring things with Cloudera Manager
    has been seamless. I've primarily used HDFS and MR1 at this point and both
    have worked perfectly. Next step for me is to set up a CDH cluster that is
    integrated with the rest of cluster set up in my company which uses Puppet
    to manage all machines.

    What I need is, to be able to specify set up for each Hadoop machine
    using Puppet manifests and use them to bring up the cluster and keep it in
    a working state. It will be great if we could still use Cloudera Manger for
    monitoring purposes but when we need to add new machines to the cluster, we
    want to be able to set up the new machine using Puppet manifest too.

    I would really appreciate suggestions on how to go about doing it.

    Thanks in Advance,
    Pankaj

    --


Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedNov 15, '12 at 9:42p
activeNov 15, '12 at 9:45p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Bala Venkatrao: 1 post Philip Zeyliger: 1 post

People

Translate

site design / logo © 2022 Grokbase