FAQ
We are using cloudera manager 4.5.2. Does Cloudera manager handle ulimit
when it starts a process?

Should we always set ulimit in OS level by ourselves?

Thanks.

Search Discussions

  • Joe Travaglini at Aug 8, 2013 at 7:15 pm
    By "handle ulimit", if you mean does CM raise the max number of allowed
    open file handles and processes for Hadoop related things, then the answer
    it 'yes', it does. You should be all set.

    To confirm, you can go to any CM-managed node, `ps -ef | grep hadoop`, grab
    the pid of a hadoop process at `cat /proc/<pid>/fd` to make sure it's
    sticking.

    Hope this helps

    On Thu, Aug 8, 2013 at 3:10 PM, wrote:

    We are using cloudera manager 4.5.2. Does Cloudera manager handle ulimit
    when it starts a process?

    Should we always set ulimit in OS level by ourselves?

    Thanks.
  • Bewang Tech at Aug 8, 2013 at 9:03 pm
    Thanks.

    Only fix a typo: "cat /proc/<pid>/limits" on CentOS 6.
    On Thursday, August 8, 2013 12:15:30 PM UTC-7, Joe Travaglini wrote:

    By "handle ulimit", if you mean does CM raise the max number of allowed
    open file handles and processes for Hadoop related things, then the answer
    it 'yes', it does. You should be all set.

    To confirm, you can go to any CM-managed node, `ps -ef | grep hadoop`,
    grab the pid of a hadoop process at `cat /proc/<pid>/fd` to make sure it's
    sticking.

    Hope this helps

    On Thu, Aug 8, 2013 at 3:10 PM, <bewan...@gmail.com <javascript:>> wrote:

    We are using cloudera manager 4.5.2. Does Cloudera manager handle ulimit
    when it starts a process?

    Should we always set ulimit in OS level by ourselves?

    Thanks.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedAug 8, '13 at 7:10p
activeAug 8, '13 at 9:03p
posts3
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Bewang Tech: 2 posts Joe Travaglini: 1 post

People

Translate

site design / logo © 2022 Grokbase