FAQ
Hi,

I have installed CDH4 using Cloudera Manager Parcels with Hadoop(HDFS,
YARN).

But, I have made entries to configure capacity scheduler within *
conf/capacity-scheduler.xml* after that i have restarted YARN. After I have
check the scheduler status in ResourcesManager UI, still it is showing that
FIFO.

How to configure the capacity scheduler, please advise.

thank you,
Munna

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Search Discussions

  • Harsh J at Sep 20, 2013 at 8:39 am
    You need to change configs via Cloudera Manager. Visit CM -> YARN ->
    Configuration (View and Edit) -> Search for "scheduler" and find the
    appropriate property to change.
    On Fri, Sep 20, 2013 at 11:50 AM, munna hadoop wrote:
    Hi,

    I have installed CDH4 using Cloudera Manager Parcels with Hadoop(HDFS,
    YARN).

    But, I have made entries to configure capacity scheduler within
    conf/capacity-scheduler.xml after that i have restarted YARN. After I have
    check the scheduler status in ResourcesManager UI, still it is showing that
    FIFO.

    How to configure the capacity scheduler, please advise.

    thank you,
    Munna

    To unsubscribe from this group and stop receiving emails from it, send an
    email to scm-users+unsubscribe@cloudera.org.


    --
    Harsh J

    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Harsh J at Sep 20, 2013 at 5:52 pm
    I don't think this plan is feasible - why not port forward via ssh and
    view the UIs? There are several things in Hadoop that would require UI
    access - removing it completely doesn't look like the right thing to
    do. If security is a concern, you should look at strong authentication
    options.

    If you use CM, you can either use its REST API
    (http://cloudera.github.com/cm_api/) to configure and control a CDH
    cluster from the command line by writing your own scripts/programs, or
    use its web UI to do the same thing. There are REST API tutorials
    available at http://cloudera.github.io/cm_api/apidocs/v5/tutorial.html
    On Fri, Sep 20, 2013 at 11:14 PM, munna hadoop wrote:
    I am an Admin. Initially we have planned this with the UI, but, some reason
    we have to move some other network there we don't have any kind of UI access
    to outside network, where we can able to login to the server(terminal
    Access) that's it!

    Please advise how can I move ahead!

    Thank you

    On 20 September 2013 22:58, Harsh J wrote:

    Sorry but I am finding that hard to believe. How do you then plan to
    manage your cluster? Via CM API commands? Are you the admin of such a
    cluster? Cause the change you speak of is an Admin level change.
    On Sep 20, 2013 10:56 PM, "munna hadoop" wrote:

    Yes! Harsh. We don't have Web UI access.

    On 20 September 2013 18:52, Harsh J wrote:

    I don't understand. Don't the admins have web ui access to CM to control
    the cluster?
    On Sep 20, 2013 6:05 PM, "munna hadoop" wrote:

    Thank you , Harsha.

    Since we are moving to production, I think, we don't have web UI access
    to manage CM. In that case how can i move ahead?

    On 20 September 2013 14:54, Harsh J wrote:

    Because that's not the service config XML.

    On Sep 20, 2013 2:48 PM, "munna hadoop" <munna.hadoop@gmail.com>
    wrote:
    Why this .xml file not taking after configure?

    On 20 September 2013 14:09, Harsh J wrote:

    You need to change configs via Cloudera Manager. Visit CM -> YARN ->
    Configuration (View and Edit) -> Search for "scheduler" and find the
    appropriate property to change.

    On Fri, Sep 20, 2013 at 11:50 AM, munna hadoop
    wrote:
    Hi,

    I have installed CDH4 using Cloudera Manager Parcels with
    Hadoop(HDFS,
    YARN).

    But, I have made entries to configure capacity scheduler within
    conf/capacity-scheduler.xml after that i have restarted YARN.
    After I have
    check the scheduler status in ResourcesManager UI, still it is
    showing that
    FIFO.

    How to configure the capacity scheduler, please advise.

    thank you,
    Munna

    To unsubscribe from this group and stop receiving emails from it,
    send an
    email to scm-users+unsubscribe@cloudera.org.


    --
    Harsh J


    --
    Harsh J

    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Munna hadoop at Sep 20, 2013 at 6:07 pm
    Harsh,

    Thank you so much for your kind information.

    One last question is, from where CM load it's configuration changes(like
    .xml) and can I get CM administration tutorials?

    Thank you

    On 20 September 2013 23:22, Harsh J wrote:

    I don't think this plan is feasible - why not port forward via ssh and
    view the UIs? There are several things in Hadoop that would require UI
    access - removing it completely doesn't look like the right thing to
    do. If security is a concern, you should look at strong authentication
    options.

    If you use CM, you can either use its REST API
    (http://cloudera.github.com/cm_api/) to configure and control a CDH
    cluster from the command line by writing your own scripts/programs, or
    use its web UI to do the same thing. There are REST API tutorials
    available at http://cloudera.github.io/cm_api/apidocs/v5/tutorial.html
    On Fri, Sep 20, 2013 at 11:14 PM, munna hadoop wrote:
    I am an Admin. Initially we have planned this with the UI, but, some reason
    we have to move some other network there we don't have any kind of UI access
    to outside network, where we can able to login to the server(terminal
    Access) that's it!

    Please advise how can I move ahead!

    Thank you

    On 20 September 2013 22:58, Harsh J wrote:

    Sorry but I am finding that hard to believe. How do you then plan to
    manage your cluster? Via CM API commands? Are you the admin of such a
    cluster? Cause the change you speak of is an Admin level change.
    On Sep 20, 2013 10:56 PM, "munna hadoop" wrote:

    Yes! Harsh. We don't have Web UI access.

    On 20 September 2013 18:52, Harsh J wrote:

    I don't understand. Don't the admins have web ui access to CM to
    control
    the cluster?
    On Sep 20, 2013 6:05 PM, "munna hadoop" wrote:

    Thank you , Harsha.

    Since we are moving to production, I think, we don't have web UI
    access
    to manage CM. In that case how can i move ahead?

    On 20 September 2013 14:54, Harsh J wrote:

    Because that's not the service config XML.

    On Sep 20, 2013 2:48 PM, "munna hadoop" <munna.hadoop@gmail.com>
    wrote:
    Why this .xml file not taking after configure?

    On 20 September 2013 14:09, Harsh J wrote:

    You need to change configs via Cloudera Manager. Visit CM -> YARN
    ->
    Configuration (View and Edit) -> Search for "scheduler" and find
    the
    appropriate property to change.

    On Fri, Sep 20, 2013 at 11:50 AM, munna hadoop
    wrote:
    Hi,

    I have installed CDH4 using Cloudera Manager Parcels with
    Hadoop(HDFS,
    YARN).

    But, I have made entries to configure capacity scheduler within
    conf/capacity-scheduler.xml after that i have restarted YARN.
    After I have
    check the scheduler status in ResourcesManager UI, still it is
    showing that
    FIFO.

    How to configure the capacity scheduler, please advise.

    thank you,
    Munna

    To unsubscribe from this group and stop receiving emails from
    it,
    send an
    email to scm-users+unsubscribe@cloudera.org.


    --
    Harsh J


    --
    Harsh J
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedSep 20, '13 at 6:20a
activeSep 20, '13 at 6:07p
posts4
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Harsh J: 2 posts Munna hadoop: 2 posts

People

Translate

site design / logo © 2022 Grokbase