Grokbase › Groups › Hadoop › scm-users › February 2013
FAQ
Hello Experts,

We have deployed cdh4.1.3 on our cluster using cloudera manager and will
be managing it using cdh going forward.

We were not using cloudera manager before and have developed certain
scripts to test cluster scalability and other features using shell
scripts. We use to start and stop hadoop services using service commands
through the scripts.

Now when using cloudera manager, shell commands for services will not work
as the services are managed by cm.

So it there a way I can use my command line scripts while still managing
the cluster using cloudera manager .

What is the recommended way to run bench marks on cluster managed by
cloudera manager.

Thanks,
Romit.

Search Discussions

  • Philip Zeyliger at Feb 8, 2013 at 7:48 pm ⇧
    Hi Romit,

    You should take a look at
    http://blog.cloudera.com/blog/2012/09/automating-your-cluster-with-cloudera-manager-api/
    for
    a walkthrough of CM's API support. You'll be able to use the python client
    (https://github.com/cloudera/cm_api) or just 'curl' to automate operations
    on the cluster.

    As for benchmarks, those tend to be MapReduce jobs, so you simply download
    the client configuration (or ask CM to deploy it to the relevant host
    you're running the benchmark from) and do that.

    Cheers,

    -- Philip


    On Fri, Feb 8, 2013 at 11:04 AM, Romit Singhai wrote:

    Hello Experts,

    We have deployed cdh4.1.3 on our cluster using cloudera manager and will
    be managing it using cdh going forward.

    We were not using cloudera manager before and have developed certain
    scripts to test cluster scalability and other features using shell
    scripts. We use to start and stop hadoop services using service commands
    through the scripts.

    Now when using cloudera manager, shell commands for services will not work
    as the services are managed by cm.

    So it there a way I can use my command line scripts while still managing
    the cluster using cloudera manager .

    What is the recommended way to run bench marks on cluster managed by
    cloudera manager.

    Thanks,
    Romit.
  • Aaron T. Myers at Feb 8, 2013 at 9:57 pm ⇧
    +scm-users@
    bcc: cdh-user@

    Hi Romit,

    I suspect the scm-users@ list will be able to help you with this question.


    --
    Aaron T. Myers
    Software Engineer, Cloudera

    On Fri, Feb 8, 2013 at 10:23 AM, Romit Singhai wrote:





    Hello Experts,

    We have deployed cdh4.1.3 on our cluster using cloudera manager and will
    be managing it using cdh going forward.

    We were not using cloudera manager before and have developed certain
    scripts to test cluster scalability and other features using shell
    scripts. We use to start and stop hadoop services using service commands
    through the scripts.

    Now when using cloudera manager, shell commands for services will not work
    as the services are managed by cm.

    So it there a way I can use my command line scripts while still managing
    the cluster using cloudera manager .

    What is the recommended way to run bench marks on cluster managed by
    cloudera manager.

    Thanks,
    Romit.

    --


  • Patrick Angeles at Feb 9, 2013 at 2:35 am ⇧
    Romit,

    Your existing scripts likely won't work as is. However, Cloudera Manager
    does come with an extensive REST API that allows you to start/stop services
    and make configuration changes, among other things. There is also a Python
    client API that wraps the REST calls conveniently for you.

    Please see http://cloudera.github.com/cm_api/ for download links and
    documentation.

    On Fri, Feb 8, 2013 at 2:04 PM, Romit Singhai wrote:

    Hello Experts,

    We have deployed cdh4.1.3 on our cluster using cloudera manager and will
    be managing it using cdh going forward.

    We were not using cloudera manager before and have developed certain
    scripts to test cluster scalability and other features using shell
    scripts. We use to start and stop hadoop services using service commands
    through the scripts.

    Now when using cloudera manager, shell commands for services will not work
    as the services are managed by cm.

    So it there a way I can use my command line scripts while still managing
    the cluster using cloudera manager .

    What is the recommended way to run bench marks on cluster managed by
    cloudera manager.

    Thanks,
    Romit.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedFeb 8, '13 at 7:48p
activeFeb 9, '13 at 2:35a
posts4
users4
websitecloudera.com
irc#hadoop

4 users in discussion

Philip Zeyliger: 1 post Romit Singhai: 1 post Patrick Angeles: 1 post Aaron T. Myers: 1 post

Content

People

Support

Translate

site design / logo © 2023 Grokbase