FAQ
After completing a "successful" Cloudera Manager installation (with default
options) on only one host (Ubuntu 12.04 LTS Server) with firewall down
(iptables -flush), we get "The inspector failed to run on all hosts."

We noticed in the installation "Details" :
Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

Also "service cloudera-scm-agent start" response with "Couldn't start
cloudera-scm-agent"

There is no log file but /var/log/cloudera-scm-agent/cloudera-scm-agent.out
reads:

Traceback (most recent call last):
File "/usr/lib/cmf/agent/src/cmf/agent.py", line 19, in <module>
import psutil
File
"/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/__init__.py",
line 84, in <module>
TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
File
"/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py",
line 122, in phymem_usage
percent = usage_percent(total - (free + buffers + cached), total,
TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

Can you please suggest a fix?

-Alton

Search Discussions

  • Mark Schnegelberger at Jan 10, 2013 at 6:18 pm
    Hi Alton - refer to this earlier thread and see if the proposed solution
    assists you:

    https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation (with
    default options) on only one host (Ubuntu 12.04 LTS Server) with firewall
    down (iptables -flush), we get "The inspector failed to run on all hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't start
    cloudera-scm-agent"

    There is no log file
    but /var/log/cloudera-scm-agent/cloudera-scm-agent.out reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/agent.py", line 19, in <module>
    import psutil
    File
    "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/__init__.py",
    line 84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File
    "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py",
    line 122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Alton Ing at Jan 10, 2013 at 6:34 pm
    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with the
    same (as above) message
    from /var/log/cloudera-scm-agent/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed solution
    assists you:


    https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion

    Regards,
    --
    Mark S.


    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing <al...@altoning.com<javascript:>
    wrote:
    After completing a "successful" Cloudera Manager installation (with
    default options) on only one host (Ubuntu 12.04 LTS Server) with firewall
    down (iptables -flush), we get "The inspector failed to run on all hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't start
    cloudera-scm-agent"

    There is no log file
    but /var/log/cloudera-scm-agent/cloudera-scm-agent.out reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/agent.py", line 19, in <module>
    import psutil
    File
    "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/__init__.py",
    line 84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File
    "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py",
    line 122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Philip Zeyliger at Jan 10, 2013 at 8:24 pm
    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it handles
    /proc/meminfo. We depend on psutil in our agent code, so it's affecting
    you that way.

    http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this
    http://code.google.com/p/psutil/issues/detail?id=232

    Are you running under some virtualization technology? Which? You could
    almost certainly hack through this by
    editing /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py
    directly. We'll file a big internally to fix this up in a future release.
    Any information about your machine configuration would be quite useful.

    Thanks,

    -- Philip


    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing wrote:

    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with the
    same (as above) message
    from /var/log/cloudera-scm-agent/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed solution
    assists you:

    https://groups.google.com/a/**cloudera.org/d/topic/scm-**
    users/ZTcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation (with
    default options) on only one host (Ubuntu 12.04 LTS Server) with firewall
    down (iptables -flush), we get "The inspector failed to run on all hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't start
    cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agent/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**agent.py", line 19, in <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/**lib/python2.7/site-packages/**
    psutil-0.3.0-py2.7-linux-x86_**64.egg/psutil/__init__.py", line 84, in
    <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/**lib/python2.7/site-packages/**
    psutil-0.3.0-py2.7-linux-x86_**64.egg/psutil/_pslinux.py", line 122, in
    phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Alton Ing at Jan 10, 2013 at 8:42 pm
    Hi Philip


    Correct. I'm running Ubuntu 12.04 LTS Server on a VPS (virtual private
    server). Not sure about the server specs. See
    http://www.futurehosting.com/web-hosting/no-control-panel-vps/pricing .

    I tried the following but still cannot start cloudera-scm-agent:

    cat /proc/meminfo >/tmp/meminfo
    echo "Buffers: 0 kB" >> /tmp/meminfo
    service cloudera-scm-agent start

    Please send me instructions on how to patch
    /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py

    -Alton
    On Thursday, 10 January 2013 12:23:39 UTC-8, Philip Zeyliger wrote:

    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it handles
    /proc/meminfo. We depend on psutil in our agent code, so it's affecting
    you that way.


    http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this
    http://code.google.com/p/psutil/issues/detail?id=232

    Are you running under some virtualization technology? Which? You could
    almost certainly hack through this by
    editing /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py
    directly. We'll file a big internally to fix this up in a future release.
    Any information about your machine configuration would be quite useful.

    Thanks,

    -- Philip



    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing <al...@altoning.com<javascript:>
    wrote:
    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with the
    same (as above) message
    from /var/log/cloudera-scm-agent/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed solution
    assists you:

    https://groups.google.com/a/**cloudera.org/d/topic/scm-**
    users/ZTcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation (with
    default options) on only one host (Ubuntu 12.04 LTS Server) with firewall
    down (iptables -flush), we get "The inspector failed to run on all hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't start
    cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agent/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**agent.py", line 19, in <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/**lib/python2.7/site-packages/**
    psutil-0.3.0-py2.7-linux-x86_**64.egg/psutil/__init__.py", line 84, in
    <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/**lib/python2.7/site-packages/**
    psutil-0.3.0-py2.7-linux-x86_**64.egg/psutil/_pslinux.py", line 122,
    in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Philip Zeyliger at Jan 10, 2013 at 8:49 pm
    Replace line 110:

    total = free = buffers = cached = None

    with:

    total = free = buffers = cached = 0

    Note that python is indentation-sensitive, so be sure to ident with spaces
    and the same amount as before.

    I haven't had the opportunity to try this, but it looks like it ought to
    work, or at least get you farther.


    On Thu, Jan 10, 2013 at 12:42 PM, Alton Ing wrote:

    Hi Philip


    Correct. I'm running Ubuntu 12.04 LTS Server on a VPS (virtual private
    server). Not sure about the server specs. See
    http://www.futurehosting.com/web-hosting/no-control-panel-vps/pricing .

    I tried the following but still cannot start cloudera-scm-agent:

    cat /proc/meminfo >/tmp/meminfo
    echo "Buffers: 0 kB" >> /tmp/meminfo
    service cloudera-scm-agent start

    Please send me instructions on how to patch

    /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py

    -Alton

    On Thursday, 10 January 2013 12:23:39 UTC-8, Philip Zeyliger wrote:

    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it handles
    /proc/meminfo. We depend on psutil in our agent code, so it's affecting
    you that way.

    http://stackoverflow.com/**questions/11402460/cloudera-**
    cdh3-installation-failure-how-**to-get-around-this<http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this>
    http://code.google.com/p/**psutil/issues/detail?id=232<http://code.google.com/p/psutil/issues/detail?id=232>

    Are you running under some virtualization technology? Which? You could
    almost certainly hack through this by editing /usr/lib/cmf/agent/**
    build/env/lib/python2.7/site-**packages/psutil-0.3.0-py2.7-**
    linux-x86_64.egg/psutil/_**pslinux.py directly. We'll file a big
    internally to fix this up in a future release. Any information about your
    machine configuration would be quite useful.

    Thanks,

    -- Philip


    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing wrote:

    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with the
    same (as above) message from /var/log/cloudera-scm-**
    agent/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed
    solution assists you:

    https://groups.google.com/a/**cl**oudera.org/d/topic/scm-**users/**
    ZTcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation (with
    default options) on only one host (Ubuntu 12.04 LTS Server) with firewall
    down (iptables -flush), we get "The inspector failed to run on all hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't start
    cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agen**t/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**ag**ent.py", line 19, in <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/****lib/python2.7/site-packages/**
    ps**util-0.3.0-py2.7-linux-x86_**64.**egg/psutil/__init__.py", line
    84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/****lib/python2.7/site-packages/**
    ps**util-0.3.0-py2.7-linux-x86_**64.**egg/psutil/_pslinux.py", line
    122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Alton Ing at Jan 10, 2013 at 9:12 pm
    Hi Philip

    With the above patch cloudera-scm-agent "appears" to have started. However,
    I still get "The inspector failed to run on all hosts."

    The following link contains the contents of
    /var/log/cloudera-scm-agent/cloudera-scm-agent.log
    http://pastebin.com/evUTkxrw

    Is it possible "inspector failed" is not related to the agent?

    -Alton
    On Thursday, 10 January 2013 12:49:28 UTC-8, Philip Zeyliger wrote:

    Replace line 110:

    total = free = buffers = cached = None

    with:

    total = free = buffers = cached = 0

    Note that python is indentation-sensitive, so be sure to ident with spaces
    and the same amount as before.

    I haven't had the opportunity to try this, but it looks like it ought to
    work, or at least get you farther.



    On Thu, Jan 10, 2013 at 12:42 PM, Alton Ing <al...@altoning.com<javascript:>
    wrote:
    Hi Philip


    Correct. I'm running Ubuntu 12.04 LTS Server on a VPS (virtual private
    server). Not sure about the server specs. See
    http://www.futurehosting.com/web-hosting/no-control-panel-vps/pricing .

    I tried the following but still cannot start cloudera-scm-agent:

    cat /proc/meminfo >/tmp/meminfo
    echo "Buffers: 0 kB" >> /tmp/meminfo
    service cloudera-scm-agent start

    Please send me instructions on how to patch

    /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py

    -Alton

    On Thursday, 10 January 2013 12:23:39 UTC-8, Philip Zeyliger wrote:

    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it
    handles /proc/meminfo. We depend on psutil in our agent code, so it's
    affecting you that way.

    http://stackoverflow.com/**questions/11402460/cloudera-**
    cdh3-installation-failure-how-**to-get-around-this<http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this>
    http://code.google.com/p/**psutil/issues/detail?id=232<http://code.google.com/p/psutil/issues/detail?id=232>

    Are you running under some virtualization technology? Which? You could
    almost certainly hack through this by editing /usr/lib/cmf/agent/**
    build/env/lib/python2.7/site-**packages/psutil-0.3.0-py2.7-**
    linux-x86_64.egg/psutil/_**pslinux.py directly. We'll file a big
    internally to fix this up in a future release. Any information about your
    machine configuration would be quite useful.

    Thanks,

    -- Philip


    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing wrote:

    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with the
    same (as above) message from /var/log/cloudera-scm-**
    agent/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed
    solution assists you:

    https://groups.google.com/a/**cl**oudera.org/d/topic/scm-**users/**
    ZTcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation (with
    default options) on only one host (Ubuntu 12.04 LTS Server) with firewall
    down (iptables -flush), we get "The inspector failed to run on all hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't start
    cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agen**t/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**ag**ent.py", line 19, in <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/****lib/python2.7/site-packages/**
    ps**util-0.3.0-py2.7-linux-x86_**64.**egg/psutil/__init__.py", line
    84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/****lib/python2.7/site-packages/**
    ps**util-0.3.0-py2.7-linux-x86_**64.**egg/psutil/_pslinux.py", line
    122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Alton Ing at Jan 11, 2013 at 3:12 pm
    How can I confirm that cloudera-scm-agent is working correctly?

    supervisord.log looks ok. See http://pastebin.com/AKbYXwwr
    cloudera-scm-agent.out looks ok. See http://pastebin.com/dcfnUczN

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/2FpME7je

    If it's helpful, here are the file permissions

    cd /var/log ; ls -l | grep cloudera
    drwxr-xr-x 2 root root 4.0K Dec 4 08:58
    cloudera-manager-daemons
    drwxr-xr-x 2 root root 4.0K Jan 9 20:32
    cloudera-manager-installer
    drwxr-x--- 2 root root 4.0K Jan 11 07:03 cloudera-scm-agent
    drwxr-x--- 2 cloudera-scm cloudera-scm 4.0K Jan 9 20:32 cloudera-scm-server

    cd /var/log/cloudera-scm-agent/ ; ls -l
    total 72
    -rw-r--r-- 1 root root 58592 Jan 11 07:07 cloudera-scm-agent.log
    -rw-r--r-- 1 root root 396 Jan 11 07:02 cloudera-scm-agent.out
    -rw-r--r-- 1 root root 541 Jan 11 07:02 supervisord.log

    Am I correct to assume "inspector failed" is still related
    to cloudera-scm-agent not running correctly?

    -Alton
    On Thursday, 10 January 2013 13:12:00 UTC-8, Alton Ing wrote:

    Hi Philip

    With the above patch cloudera-scm-agent "appears" to have started.
    However, I still get "The inspector failed to run on all hosts."

    The following link contains the contents of
    /var/log/cloudera-scm-agent/cloudera-scm-agent.log
    http://pastebin.com/evUTkxrw

    Is it possible "inspector failed" is not related to the agent?

    -Alton
    On Thursday, 10 January 2013 12:49:28 UTC-8, Philip Zeyliger wrote:

    Replace line 110:

    total = free = buffers = cached = None

    with:

    total = free = buffers = cached = 0

    Note that python is indentation-sensitive, so be sure to ident with
    spaces and the same amount as before.

    I haven't had the opportunity to try this, but it looks like it ought to
    work, or at least get you farther.


    On Thu, Jan 10, 2013 at 12:42 PM, Alton Ing wrote:

    Hi Philip


    Correct. I'm running Ubuntu 12.04 LTS Server on a VPS (virtual private
    server). Not sure about the server specs. See
    http://www.futurehosting.com/web-hosting/no-control-panel-vps/pricing .

    I tried the following but still cannot start cloudera-scm-agent:

    cat /proc/meminfo >/tmp/meminfo
    echo "Buffers: 0 kB" >> /tmp/meminfo
    service cloudera-scm-agent start

    Please send me instructions on how to patch

    /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/_pslinux.py

    -Alton

    On Thursday, 10 January 2013 12:23:39 UTC-8, Philip Zeyliger wrote:

    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it
    handles /proc/meminfo. We depend on psutil in our agent code, so it's
    affecting you that way.

    http://stackoverflow.com/**questions/11402460/cloudera-**
    cdh3-installation-failure-how-**to-get-around-this<http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this>
    http://code.google.com/p/**psutil/issues/detail?id=232<http://code.google.com/p/psutil/issues/detail?id=232>

    Are you running under some virtualization technology? Which? You
    could almost certainly hack through this by editing /usr/lib/cmf/agent/
    **build/env/lib/python2.7/site-**packages/psutil-0.3.0-py2.7-**
    linux-x86_64.egg/psutil/_**pslinux.py directly. We'll file a big
    internally to fix this up in a future release. Any information about your
    machine configuration would be quite useful.

    Thanks,

    -- Philip


    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing wrote:

    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with
    the same (as above) message from /var/log/cloudera-scm-**
    agent/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed
    solution assists you:

    https://groups.google.com/a/**cl**oudera.org/d/topic/scm-**users/**
    ZTcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation (with
    default options) on only one host (Ubuntu 12.04 LTS Server) with firewall
    down (iptables -flush), we get "The inspector failed to run on all hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't
    start cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agen**t/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**ag**ent.py", line 19, in <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/****lib/python2.7/site-packages/*
    *ps**util-0.3.0-py2.7-linux-x86_**64.**egg/psutil/__init__.py",
    line 84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/****lib/python2.7/site-packages/*
    *ps**util-0.3.0-py2.7-linux-x86_**64.**egg/psutil/_pslinux.py",
    line 122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Philip Zeyliger at Jan 11, 2013 at 6:56 pm

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/2FpME7je
    File
    "/usr/lib/cmf/agent/build/env/local/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux->
    x86_64.egg/psutil/_pslinux.py", line 101, in phymem_buffers
    raise RuntimeError("line not found")
    This looks very similar to what we were dealing with above. Try replacing
    that line (101) with "return 0".

    The agent is running, but it's failing to heartbeat because of that.

    -- Philip



    On Fri, Jan 11, 2013 at 7:12 AM, Alton Ing wrote:

    How can I confirm that cloudera-scm-agent is working correctly?

    supervisord.log looks ok. See http://pastebin.com/AKbYXwwr
    cloudera-scm-agent.out looks ok. See http://pastebin.com/dcfnUczN

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/2FpME7je

    If it's helpful, here are the file permissions

    cd /var/log ; ls -l | grep cloudera
    drwxr-xr-x 2 root root 4.0K Dec 4 08:58
    cloudera-manager-daemons
    drwxr-xr-x 2 root root 4.0K Jan 9 20:32
    cloudera-manager-installer
    drwxr-x--- 2 root root 4.0K Jan 11 07:03 cloudera-scm-agent
    drwxr-x--- 2 cloudera-scm cloudera-scm 4.0K Jan 9 20:32
    cloudera-scm-server

    cd /var/log/cloudera-scm-agent/ ; ls -l
    total 72
    -rw-r--r-- 1 root root 58592 Jan 11 07:07 cloudera-scm-agent.log
    -rw-r--r-- 1 root root 396 Jan 11 07:02 cloudera-scm-agent.out
    -rw-r--r-- 1 root root 541 Jan 11 07:02 supervisord.log

    Am I correct to assume "inspector failed" is still related
    to cloudera-scm-agent not running correctly?

    -Alton
    On Thursday, 10 January 2013 13:12:00 UTC-8, Alton Ing wrote:

    Hi Philip

    With the above patch cloudera-scm-agent "appears" to have started.
    However, I still get "The inspector failed to run on all hosts."

    The following link contains the contents of /var/log/cloudera-scm-agent/*
    *cloudera-scm-agent.log
    http://pastebin.com/evUTkxrw

    Is it possible "inspector failed" is not related to the agent?

    -Alton
    On Thursday, 10 January 2013 12:49:28 UTC-8, Philip Zeyliger wrote:

    Replace line 110:

    total = free = buffers = cached = None

    with:

    total = free = buffers = cached = 0

    Note that python is indentation-sensitive, so be sure to ident with
    spaces and the same amount as before.

    I haven't had the opportunity to try this, but it looks like it ought to
    work, or at least get you farther.


    On Thu, Jan 10, 2013 at 12:42 PM, Alton Ing wrote:

    Hi Philip


    Correct. I'm running Ubuntu 12.04 LTS Server on a VPS (virtual private
    server). Not sure about the server specs. See
    http://www.futurehosting.com/**web-hosting/no-control-panel-**
    vps/pricing<http://www.futurehosting.com/web-hosting/no-control-panel-vps/pricing>.

    I tried the following but still cannot start cloudera-scm-agent:

    cat /proc/meminfo >/tmp/meminfo
    echo "Buffers: 0 kB" >> /tmp/meminfo
    service cloudera-scm-agent start

    Please send me instructions on how to patch
    /usr/lib/cmf/agent/build/env/**lib/python2.7/site-packages/**
    psutil-0.3.0-py2.7-linux-x86_**64.egg/psutil/_pslinux.py

    -Alton

    On Thursday, 10 January 2013 12:23:39 UTC-8, Philip Zeyliger wrote:

    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it
    handles /proc/meminfo. We depend on psutil in our agent code, so it's
    affecting you that way.

    http://stackoverflow.com/**quest**ions/11402460/cloudera-**cdh3-**
    installation-failure-how-**to-**get-around-this<http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this>
    http://code.google.com/p/**psuti**l/issues/detail?id=232<http://code.google.com/p/psutil/issues/detail?id=232>

    Are you running under some virtualization technology? Which? You
    could almost certainly hack through this by editing /usr/lib/cmf/agent/
    **bui**ld/env/lib/python2.7/site-**pack**ages/psutil-0.3.0-py2.7-**
    linux-**x86_64.egg/psutil/_**pslinux.py directly. We'll file a big
    internally to fix this up in a future release. Any information about your
    machine configuration would be quite useful.

    Thanks,

    -- Philip


    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing wrote:

    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with
    the same (as above) message from /var/log/cloudera-scm-**age**
    nt/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed
    solution assists you:

    https://groups.google.com/a/**cl****oudera.org/d/topic/scm-**users/*
    *Z**TcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation (with
    default options) on only one host (Ubuntu 12.04 LTS Server) with firewall
    down (iptables -flush), we get "The inspector failed to run on all hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't
    start cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agen****t/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**ag****ent.py", line 19, in
    <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/******
    lib/python2.7/site-packages/**ps****util-0.3.0-py2.7-linux-x86_**
    64.****egg/psutil/__init__.py", line 84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/******
    lib/python2.7/site-packages/**ps****util-0.3.0-py2.7-linux-x86_**
    64.****egg/psutil/_pslinux.py", line 122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Alton Ing at Jan 11, 2013 at 7:07 pm
    Hi Philip

    Done. How does this (cloudera-scm-agent.log) look? See
    http://pastebin.com/VmUtGurN

    -Alton
    On Friday, 11 January 2013 10:56:10 UTC-8, Philip Zeyliger wrote:

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/2FpME7je
    File
    "/usr/lib/cmf/agent/build/env/local/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux->
    x86_64.egg/psutil/_pslinux.py", line 101, in phymem_buffers
    raise RuntimeError("line not found")
    This looks very similar to what we were dealing with above. Try replacing
    that line (101) with "return 0".

    The agent is running, but it's failing to heartbeat because of that.

    -- Philip




    On Fri, Jan 11, 2013 at 7:12 AM, Alton Ing <al...@altoning.com<javascript:>
    wrote:
    How can I confirm that cloudera-scm-agent is working correctly?

    supervisord.log looks ok. See http://pastebin.com/AKbYXwwr
    cloudera-scm-agent.out looks ok. See http://pastebin.com/dcfnUczN

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/2FpME7je

    If it's helpful, here are the file permissions

    cd /var/log ; ls -l | grep cloudera
    drwxr-xr-x 2 root root 4.0K Dec 4 08:58
    cloudera-manager-daemons
    drwxr-xr-x 2 root root 4.0K Jan 9 20:32
    cloudera-manager-installer
    drwxr-x--- 2 root root 4.0K Jan 11 07:03
    cloudera-scm-agent
    drwxr-x--- 2 cloudera-scm cloudera-scm 4.0K Jan 9 20:32
    cloudera-scm-server

    cd /var/log/cloudera-scm-agent/ ; ls -l
    total 72
    -rw-r--r-- 1 root root 58592 Jan 11 07:07 cloudera-scm-agent.log
    -rw-r--r-- 1 root root 396 Jan 11 07:02 cloudera-scm-agent.out
    -rw-r--r-- 1 root root 541 Jan 11 07:02 supervisord.log

    Am I correct to assume "inspector failed" is still related
    to cloudera-scm-agent not running correctly?

    -Alton
    On Thursday, 10 January 2013 13:12:00 UTC-8, Alton Ing wrote:

    Hi Philip

    With the above patch cloudera-scm-agent "appears" to have started.
    However, I still get "The inspector failed to run on all hosts."

    The following link contains the contents of /var/log/cloudera-scm-agent/
    **cloudera-scm-agent.log
    http://pastebin.com/evUTkxrw

    Is it possible "inspector failed" is not related to the agent?

    -Alton
    On Thursday, 10 January 2013 12:49:28 UTC-8, Philip Zeyliger wrote:

    Replace line 110:

    total = free = buffers = cached = None

    with:

    total = free = buffers = cached = 0

    Note that python is indentation-sensitive, so be sure to ident with
    spaces and the same amount as before.

    I haven't had the opportunity to try this, but it looks like it ought
    to work, or at least get you farther.


    On Thu, Jan 10, 2013 at 12:42 PM, Alton Ing wrote:

    Hi Philip


    Correct. I'm running Ubuntu 12.04 LTS Server on a VPS (virtual private
    server). Not sure about the server specs. See
    http://www.futurehosting.com/**web-hosting/no-control-panel-**
    vps/pricing<http://www.futurehosting.com/web-hosting/no-control-panel-vps/pricing>.

    I tried the following but still cannot start cloudera-scm-agent:

    cat /proc/meminfo >/tmp/meminfo
    echo "Buffers: 0 kB" >> /tmp/meminfo
    service cloudera-scm-agent start

    Please send me instructions on how to patch
    /usr/lib/cmf/agent/build/env/**lib/python2.7/site-packages/**
    psutil-0.3.0-py2.7-linux-x86_**64.egg/psutil/_pslinux.py

    -Alton

    On Thursday, 10 January 2013 12:23:39 UTC-8, Philip Zeyliger wrote:

    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it
    handles /proc/meminfo. We depend on psutil in our agent code, so it's
    affecting you that way.

    http://stackoverflow.com/**quest**ions/11402460/cloudera-**cdh3-**
    installation-failure-how-**to-**get-around-this<http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this>
    http://code.google.com/p/**psuti**l/issues/detail?id=232<http://code.google.com/p/psutil/issues/detail?id=232>

    Are you running under some virtualization technology? Which? You
    could almost certainly hack through this by editing /usr/lib/cmf/agent/
    **bui**ld/env/lib/python2.7/site-**pack**ages/psutil-0.3.0-py2.7-**
    linux-**x86_64.egg/psutil/_**pslinux.py directly. We'll file a big
    internally to fix this up in a future release. Any information about your
    machine configuration would be quite useful.

    Thanks,

    -- Philip


    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing wrote:

    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with
    the same (as above) message from /var/log/cloudera-scm-**age**
    nt/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed
    solution assists you:

    https://groups.google.com/a/**cl****oudera.org/d/topic/scm-**users/
    **Z**TcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation
    (with default options) on only one host (Ubuntu 12.04 LTS Server) with
    firewall down (iptables -flush), we get "The inspector failed to run on all
    hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't
    start cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agen****t/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**ag****ent.py", line 19, in
    <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/******
    lib/python2.7/site-packages/**ps****util-0.3.0-py2.7-linux-x86_**
    64.****egg/psutil/__init__.py", line 84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/******
    lib/python2.7/site-packages/**ps****util-0.3.0-py2.7-linux-x86_**
    64.****egg/psutil/_pslinux.py", line 122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Philip Zeyliger at Jan 11, 2013 at 7:09 pm
    Looks more normal. When you go to CM and enter the "hosts" tab, do you see
    hosts heartbeating?

    On Fri, Jan 11, 2013 at 11:07 AM, Alton Ing wrote:

    Hi Philip

    Done. How does this (cloudera-scm-agent.log) look? See
    http://pastebin.com/VmUtGurN

    -Alton

    On Friday, 11 January 2013 10:56:10 UTC-8, Philip Zeyliger wrote:

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/**2FpME7je <http://pastebin.com/2FpME7je>
    File "/usr/lib/cmf/agent/build/env/**local/lib/python2.7/site-**
    packages/psutil-0.3.0-py2.7-**linux-> x86_64.egg/psutil/_pslinux.py"**,
    line 101, in phymem_buffers
    raise RuntimeError("line not found")
    This looks very similar to what we were dealing with above. Try
    replacing that line (101) with "return 0".

    The agent is running, but it's failing to heartbeat because of that.

    -- Philip



    On Fri, Jan 11, 2013 at 7:12 AM, Alton Ing wrote:

    How can I confirm that cloudera-scm-agent is working correctly?

    supervisord.log looks ok. See http://pastebin.com/AKbYXwwr
    cloudera-scm-agent.out looks ok. See http://pastebin.com/dcfnUczN

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/**2FpME7je <http://pastebin.com/2FpME7je>

    If it's helpful, here are the file permissions

    cd /var/log ; ls -l | grep cloudera
    drwxr-xr-x 2 root root 4.0K Dec 4 08:58
    cloudera-manager-daemons
    drwxr-xr-x 2 root root 4.0K Jan 9 20:32
    cloudera-manager-installer
    drwxr-x--- 2 root root 4.0K Jan 11 07:03
    cloudera-scm-agent
    drwxr-x--- 2 cloudera-scm cloudera-scm 4.0K Jan 9 20:32
    cloudera-scm-server

    cd /var/log/cloudera-scm-agent/ ; ls -l
    total 72
    -rw-r--r-- 1 root root 58592 Jan 11 07:07 cloudera-scm-agent.log
    -rw-r--r-- 1 root root 396 Jan 11 07:02 cloudera-scm-agent.out
    -rw-r--r-- 1 root root 541 Jan 11 07:02 supervisord.log

    Am I correct to assume "inspector failed" is still related
    to cloudera-scm-agent not running correctly?

    -Alton
    On Thursday, 10 January 2013 13:12:00 UTC-8, Alton Ing wrote:

    Hi Philip

    With the above patch cloudera-scm-agent "appears" to have started.
    However, I still get "The inspector failed to run on all hosts."

    The following link contains the contents of /var/log/cloudera-scm-agent/
    **cl**oudera-scm-agent.log
    http://pastebin.com/evUTkxrw

    Is it possible "inspector failed" is not related to the agent?

    -Alton
    On Thursday, 10 January 2013 12:49:28 UTC-8, Philip Zeyliger wrote:

    Replace line 110:

    total = free = buffers = cached = None

    with:

    total = free = buffers = cached = 0

    Note that python is indentation-sensitive, so be sure to ident with
    spaces and the same amount as before.

    I haven't had the opportunity to try this, but it looks like it ought
    to work, or at least get you farther.


    On Thu, Jan 10, 2013 at 12:42 PM, Alton Ing wrote:

    Hi Philip


    Correct. I'm running Ubuntu 12.04 LTS Server on a VPS (virtual
    private server). Not sure about the server specs. See
    http://www.futurehosting.com/**w**eb-hosting/no-control-panel-**vp**
    s/pricing<http://www.futurehosting.com/web-hosting/no-control-panel-vps/pricing>.

    I tried the following but still cannot start cloudera-scm-agent:

    cat /proc/meminfo >/tmp/meminfo
    echo "Buffers: 0 kB" >> /tmp/meminfo
    service cloudera-scm-agent start

    Please send me instructions on how to patch
    /usr/lib/cmf/agent/build/env/**l**ib/python2.7/site-packages/**psu**
    til-0.3.0-py2.7-linux-x86_**64.**egg/psutil/_pslinux.py

    -Alton

    On Thursday, 10 January 2013 12:23:39 UTC-8, Philip Zeyliger wrote:

    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it
    handles /proc/meminfo. We depend on psutil in our agent code, so it's
    affecting you that way.

    http://stackoverflow.com/**quest****ions/11402460/cloudera-**cdh3-**
    in**stallation-failure-how-**to-**get-**around-this<http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this>
    http://code.google.com/p/**psuti****l/issues/detail?id=232<http://code.google.com/p/psutil/issues/detail?id=232>

    Are you running under some virtualization technology? Which? You
    could almost certainly hack through this by editing /usr/lib/cmf/agent/
    **bui****ld/env/lib/python2.7/site-**pack****
    ages/psutil-0.3.0-py2.7-**linux-****x86_64.egg/psutil/_**pslinux.py
    directly. We'll file a big internally to fix this up in a future release.
    Any information about your machine configuration would be quite useful.

    Thanks,

    -- Philip


    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing wrote:

    Hi Mark

    I tried the following but still can't start cloudera-scm-agent with
    the same (as above) message from /var/log/cloudera-scm-**age****
    nt/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed
    solution assists you:

    https://groups.google.com/a/**cl******oudera.org/d/topic/scm-**
    users/**Z****TcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation
    (with default options) on only one host (Ubuntu 12.04 LTS Server) with
    firewall down (iptables -flush), we get "The inspector failed to run on all
    hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't
    start cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agen******t/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**ag******ent.py", line 19, in
    <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/********
    lib/python2.7/site-packages/**ps******util-0.3.0-py2.7-linux-x86_
    **64.******egg/psutil/__init__.py", line 84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/********
    lib/python2.7/site-packages/**ps******util-0.3.0-py2.7-linux-x86_
    **64.******egg/psutil/_pslinux.py", line 122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'

    Can you please suggest a fix?

    -Alton



  • Alton Ing at Jan 11, 2013 at 7:44 pm
    Excellent Philip. It works! Here is the summary of changes we had to make
    to complete the installation on a VPS:

    cd
    /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/psutil-0.3.0-py2.7-linux-x86_64.egg/psutil/
    diff _pslinux.py.ORIG _pslinux.py

    101c101
    < raise RuntimeError("line not found")
    ---
    return 0
    110c110
    < total = free = buffers = cached = None
    ---
    total = free = buffers = cached = 0
    The other changes we had to make to complete the installation are:

    1. mkdir /data
    2. chmod -R 777 /data
    3. set the default locations of local directories (eg. dfs.data.dir) to
    /data/...

    Some more server configuration changes include:

    1. drop the firewall using iptables --flush
    2. make /tmp executable ... normally /tmp is mounted as noexec for security
    reasons. Please consider changing the installer to accomodate this.

    Many thanks
    -Alton

    On Friday, 11 January 2013 11:09:02 UTC-8, Philip Zeyliger wrote:

    Looks more normal. When you go to CM and enter the "hosts" tab, do you
    see hosts heartbeating?


    On Fri, Jan 11, 2013 at 11:07 AM, Alton Ing <al...@altoning.com<javascript:>
    wrote:
    Hi Philip

    Done. How does this (cloudera-scm-agent.log) look? See
    http://pastebin.com/VmUtGurN

    -Alton

    On Friday, 11 January 2013 10:56:10 UTC-8, Philip Zeyliger wrote:

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/**2FpME7je <http://pastebin.com/2FpME7je>
    File "/usr/lib/cmf/agent/build/env/**local/lib/python2.7/site-**
    packages/psutil-0.3.0-py2.7-**linux-> x86_64.egg/psutil/_pslinux.py"**,
    line 101, in phymem_buffers
    raise RuntimeError("line not found")
    This looks very similar to what we were dealing with above. Try
    replacing that line (101) with "return 0".

    The agent is running, but it's failing to heartbeat because of that.

    -- Philip



    On Fri, Jan 11, 2013 at 7:12 AM, Alton Ing wrote:

    How can I confirm that cloudera-scm-agent is working correctly?

    supervisord.log looks ok. See http://pastebin.com/AKbYXwwr
    cloudera-scm-agent.out looks ok. See http://pastebin.com/dcfnUczN

    However, cloudera-scm-agent.log contains many Runtime Errors. See
    http://pastebin.com/**2FpME7je <http://pastebin.com/2FpME7je>

    If it's helpful, here are the file permissions

    cd /var/log ; ls -l | grep cloudera
    drwxr-xr-x 2 root root 4.0K Dec 4 08:58
    cloudera-manager-daemons
    drwxr-xr-x 2 root root 4.0K Jan 9 20:32
    cloudera-manager-installer
    drwxr-x--- 2 root root 4.0K Jan 11 07:03
    cloudera-scm-agent
    drwxr-x--- 2 cloudera-scm cloudera-scm 4.0K Jan 9 20:32
    cloudera-scm-server

    cd /var/log/cloudera-scm-agent/ ; ls -l
    total 72
    -rw-r--r-- 1 root root 58592 Jan 11 07:07 cloudera-scm-agent.log
    -rw-r--r-- 1 root root 396 Jan 11 07:02 cloudera-scm-agent.out
    -rw-r--r-- 1 root root 541 Jan 11 07:02 supervisord.log

    Am I correct to assume "inspector failed" is still related
    to cloudera-scm-agent not running correctly?

    -Alton
    On Thursday, 10 January 2013 13:12:00 UTC-8, Alton Ing wrote:

    Hi Philip

    With the above patch cloudera-scm-agent "appears" to have started.
    However, I still get "The inspector failed to run on all hosts."

    The following link contains the contents of
    /var/log/cloudera-scm-agent/**cl**oudera-scm-agent.log
    http://pastebin.com/evUTkxrw

    Is it possible "inspector failed" is not related to the agent?

    -Alton
    On Thursday, 10 January 2013 12:49:28 UTC-8, Philip Zeyliger wrote:

    Replace line 110:

    total = free = buffers = cached = None

    with:

    total = free = buffers = cached = 0

    Note that python is indentation-sensitive, so be sure to ident with
    spaces and the same amount as before.

    I haven't had the opportunity to try this, but it looks like it ought
    to work, or at least get you farther.


    On Thu, Jan 10, 2013 at 12:42 PM, Alton Ing wrote:

    Hi Philip


    Correct. I'm running Ubuntu 12.04 LTS Server on a VPS (virtual
    private server). Not sure about the server specs. See
    http://www.futurehosting.com/**w**eb-hosting/no-control-panel-**vp**
    s/pricing<http://www.futurehosting.com/web-hosting/no-control-panel-vps/pricing>.

    I tried the following but still cannot start cloudera-scm-agent:

    cat /proc/meminfo >/tmp/meminfo
    echo "Buffers: 0 kB" >> /tmp/meminfo
    service cloudera-scm-agent start

    Please send me instructions on how to patch
    /usr/lib/cmf/agent/build/env/**l**ib/python2.7/site-packages/**psu**
    til-0.3.0-py2.7-linux-x86_**64.**egg/psutil/_pslinux.py

    -Alton

    On Thursday, 10 January 2013 12:23:39 UTC-8, Philip Zeyliger wrote:

    Hi Alton,

    A little Googling suggests that this is a bug in psutil in how it
    handles /proc/meminfo. We depend on psutil in our agent code, so it's
    affecting you that way.

    http://stackoverflow.com/**quest****ions/11402460/cloudera-**cdh3-*
    *in**stallation-failure-how-**to-**get-**around-this<http://stackoverflow.com/questions/11402460/cloudera-cdh3-installation-failure-how-to-get-around-this>
    http://code.google.com/p/**psuti****l/issues/detail?id=232<http://code.google.com/p/psutil/issues/detail?id=232>

    Are you running under some virtualization technology? Which? You
    could almost certainly hack through this by editing /usr/lib/cmf/agent/
    **bui****ld/env/lib/python2.7/site-**pack****
    ages/psutil-0.3.0-py2.7-**linux-****x86_64.egg/psutil/_**pslinux.py
    directly. We'll file a big internally to fix this up in a future release.
    Any information about your machine configuration would be quite useful.

    Thanks,

    -- Philip


    On Thu, Jan 10, 2013 at 10:34 AM, Alton Ing wrote:

    Hi Mark

    I tried the following but still can't start cloudera-scm-agent
    with the same (as above) message from /var/log/cloudera-scm-**age*
    ***nt/cloudera-scm-agent.out

    *apt-get install python-virtualenv
    virtualenv /usr/lib/cmf/agent/build/env*
    *
    *
    *-Alton*

    On Thursday, 10 January 2013 10:18:16 UTC-8, smark wrote:

    Hi Alton - refer to this earlier thread and see if the proposed
    solution assists you:

    https://groups.google.com/a/**cl******oudera.org/d/topic/scm-**
    users/**Z****TcVjHOBRJA/discussion<https://groups.google.com/a/cloudera.org/d/topic/scm-users/ZTcVjHOBRJA/discussion>

    Regards,
    --
    Mark S.

    On Thu, Jan 10, 2013 at 12:59 PM, Alton Ing wrote:

    After completing a "successful" Cloudera Manager installation
    (with default options) on only one host (Ubuntu 12.04 LTS Server) with
    firewall down (iptables -flush), we get "The inspector failed to run on all
    hosts."

    We noticed in the installation "Details" :
    Starting cloudera-scm-agent: * Couldn't start cloudera-scm-agent

    Also "service cloudera-scm-agent start" response with "Couldn't
    start cloudera-scm-agent"

    There is no log file but /var/log/cloudera-scm-**agen******t/cloudera-scm-agent.out
    reads:

    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/**ag******ent.py", line 19, in
    <module>
    import psutil
    File "/usr/lib/cmf/agent/build/env/********
    lib/python2.7/site-packages/**ps******
    util-0.3.0-py2.7-linux-x86_**64.******egg/psutil/__init__.py",
    line 84, in <module>
    TOTAL_PHYMEM = _psplatform.phymem_usage()[0]
    File "/usr/lib/cmf/agent/build/env/********
    lib/python2.7/site-packages/**ps******
    util-0.3.0-py2.7-linux-x86_**64.******egg/psutil/_pslinux.py",
    line 122, in phymem_usage
    percent = usage_percent(total - (free + buffers + cached), total,
    TypeError: unsupported operand type(s) for +: 'int' and
    'NoneType'

    Can you please suggest a fix?

    -Alton



Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedJan 10, '13 at 5:59p
activeJan 11, '13 at 7:44p
posts12
users3
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase