FAQ
Hi,

I was able to launch 50 nofe cluster using clouder manager 4.1..

When I see the health on all nodes everything showing good except cloudera manager node, which is showing unknown.

Please advise on this.

Also do we need to install CDH4 on CM node as well. Because i did not added cloudera manager node in host list while deloying cluster.

Thanks
Chittu

Sent from my iPhone

Search Discussions

  • Philip Zeyliger at Nov 15, 2012 at 9:31 pm

    On Thu, Nov 15, 2012 at 12:40 PM, wrote:

    Hi,

    I was able to launch 50 nofe cluster using clouder manager 4.1..

    When I see the health on all nodes everything showing good except cloudera
    manager node, which is showing unknown.
    That typically means that the agent on that machine isn't heartbeating.
    Look in /var/log/cloudera-scm-agent/* to see what's going on there.

    -- Philip


    Please advise on this.

    Also do we need to install CDH4 on CM node as well. Because i did not
    added cloudera manager node in host list while deloying cluster.

    Thanks
    Chittu

    Sent from my iPhone
  • Chittu546 at Nov 16, 2012 at 4:54 pm
    Thank you philip for your reply..

    I restarted the service on cloudera manager node and still it is
    showing like that..

    Also do we need to install CDH4 on Cloudera Manager node as well.
    Because i did not added cloudera manager node in host list while
    deloying cluster.

    logs..please help me here.

    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 574, in send_heartbeat
    response = self.requestor.request('heartbeat', dict(request=heartbeat))
    File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 145, in request
    return self.issue_request(call_request, message_name, request_datum)
    File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 256, in issue_request
    call_response = self.transceiver.transceive(call_request)
    File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 485, in transceive
    result = self.read_framed_message()
    File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 491, in read_framed_message
    framed_message = response_reader.read_framed_message()
    File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 419, in read_framed_message
    raise ConnectionClosedException("Reader read 0 bytes.")
    ConnectionClosedException: Reader read 0 bytes.
    thanks
    Chittu
    On Thu, Nov 15, 2012 at 1:24 PM, Philip Zeyliger wrote:

    On Thu, Nov 15, 2012 at 12:40 PM, wrote:

    Hi,

    I was able to launch 50 nofe cluster using clouder manager 4.1..

    When I see the health on all nodes everything showing good except cloudera
    manager node, which is showing unknown.

    That typically means that the agent on that machine isn't heartbeating.
    Look in /var/log/cloudera-scm-agent/* to see what's going on there.

    -- Philip


    Please advise on this.

    Also do we need to install CDH4 on CM node as well. Because i did not
    added cloudera manager node in host list while deloying cluster.

    Thanks
    Chittu

    Sent from my iPhone
  • Philip Zeyliger at Nov 15, 2012 at 9:39 pm

    On Thu, Nov 15, 2012 at 1:36 PM, wrote:

    Thank you philip for your reply..

    I restarted the service on cloudera manager node and still it is
    showing like that..

    Also do we need to install CDH4 on Cloudera Manager node as well.
    Because i did not added cloudera manager node in host list while
    deloying cluster.

    logs..please help me here.

    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 574, in send_heartbeat
    response = self.requestor.request('heartbeat', dict(request=heartbeat))
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 145, in request
    return self.issue_request(call_request, message_name, request_datum)
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 256, in issue_request
    call_response = self.transceiver.transceive(call_request)
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 485, in transceive
    result = self.read_framed_message()
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 491, in read_framed_message
    framed_message = response_reader.read_framed_message()
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 419, in read_framed_message
    raise ConnectionClosedException("Reader read 0 bytes.")
    ConnectionClosedException: Reader read 0 bytes.
    So, there *is* an agent running there, but it's having trouble
    heartbeating. Look at /etc/cloudera-scm-agent/config.ini. Is it the same
    as the other hosts? Is the server_host configured? Is the
    cloudera-manager-agent package the same version as everywhere else? One of
    those things (followed by a "service cloudera-scm-agent restart") will do
    the trick.

    -- Philip

    thanks
    Chittu
    On Thu, Nov 15, 2012 at 1:24 PM, Philip Zeyliger wrote:

    On Thu, Nov 15, 2012 at 12:40 PM, wrote:

    Hi,

    I was able to launch 50 nofe cluster using clouder manager 4.1..

    When I see the health on all nodes everything showing good except
    cloudera
    manager node, which is showing unknown.

    That typically means that the agent on that machine isn't heartbeating.
    Look in /var/log/cloudera-scm-agent/* to see what's going on there.

    -- Philip


    Please advise on this.

    Also do we need to install CDH4 on CM node as well. Because i did not
    added cloudera manager node in host list while deloying cluster.

    Thanks
    Chittu

    Sent from my iPhone
  • Chittu546 at Nov 16, 2012 at 4:52 pm
    Hi Philip,

    server_host is configured properly. and I installed same software on all nodes.
    Now I need to install CDH4 on cloudera manager node, because we want
    to run another services on this node. but I am not able add any
    role/service to this host.

    How can I add new roles to this node, which is now showing not part of
    the cluster.

    "
    edge003.map.att.com xxxxxxxxxx /default Unknown Unknown None "

    When I deployed cluster..
    1) I launched cloudera manager node and added other 49 nodes and
    installed CDH4 and configured required services on all 49 nodes.
    2) I did not added cloudera manager node into that list..now I need to
    configure Hue, Hive and some other services on this node.

    Please help me

    Thanks,
    Chittu
    On Thu, Nov 15, 2012 at 1:38 PM, Philip Zeyliger wrote:

    On Thu, Nov 15, 2012 at 1:36 PM, wrote:

    Thank you philip for your reply..

    I restarted the service on cloudera manager node and still it is
    showing like that..

    Also do we need to install CDH4 on Cloudera Manager node as well.
    Because i did not added cloudera manager node in host list while
    deloying cluster.

    logs..please help me here.

    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 574, in send_heartbeat
    response = self.requestor.request('heartbeat',
    dict(request=heartbeat))
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 145, in request
    return self.issue_request(call_request, message_name, request_datum)
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 256, in issue_request
    call_response = self.transceiver.transceive(call_request)
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 485, in transceive
    result = self.read_framed_message()
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 491, in read_framed_message
    framed_message = response_reader.read_framed_message()
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 419, in read_framed_message
    raise ConnectionClosedException("Reader read 0 bytes.")
    ConnectionClosedException: Reader read 0 bytes.

    So, there *is* an agent running there, but it's having trouble heartbeating.
    Look at /etc/cloudera-scm-agent/config.ini. Is it the same as the other
    hosts? Is the server_host configured? Is the cloudera-manager-agent
    package the same version as everywhere else? One of those things (followed
    by a "service cloudera-scm-agent restart") will do the trick.

    -- Philip
    thanks
    Chittu

    On Thu, Nov 15, 2012 at 1:24 PM, Philip Zeyliger <philip@cloudera.com>
    wrote:
    On Thu, Nov 15, 2012 at 12:40 PM, wrote:

    Hi,

    I was able to launch 50 nofe cluster using clouder manager 4.1..

    When I see the health on all nodes everything showing good except
    cloudera
    manager node, which is showing unknown.

    That typically means that the agent on that machine isn't heartbeating.
    Look in /var/log/cloudera-scm-agent/* to see what's going on there.

    -- Philip


    Please advise on this.

    Also do we need to install CDH4 on CM node as well. Because i did not
    added cloudera manager node in host list while deloying cluster.

    Thanks
    Chittu

    Sent from my iPhone
  • Philip Zeyliger at Nov 15, 2012 at 10:15 pm
    You could try running it through the 'add host wizard' by going to the
    "hosts" tab. I haven't tried to see if that'll work--you might need to
    stop the agent and delete the host entry first.

    Alternately, you could just "yum install" the appropriate CDH packages.
    See the "Path B" installation doc for more details on which packages that
    is.

    -- Philip
    On Thu, Nov 15, 2012 at 1:56 PM, wrote:

    Hi Philip,

    server_host is configured properly. and I installed same software on all
    nodes.
    Now I need to install CDH4 on cloudera manager node, because we want
    to run another services on this node. but I am not able add any
    role/service to this host.

    How can I add new roles to this node, which is now showing not part of
    the cluster.

    "
    edge003.map.att.com xxxxxxxxxx /default Unknown Unknown
    None "

    When I deployed cluster..
    1) I launched cloudera manager node and added other 49 nodes and
    installed CDH4 and configured required services on all 49 nodes.
    2) I did not added cloudera manager node into that list..now I need to
    configure Hue, Hive and some other services on this node.

    Please help me

    Thanks,
    Chittu
    On Thu, Nov 15, 2012 at 1:38 PM, Philip Zeyliger wrote:

    On Thu, Nov 15, 2012 at 1:36 PM, wrote:

    Thank you philip for your reply..

    I restarted the service on cloudera manager node and still it is
    showing like that..

    Also do we need to install CDH4 on Cloudera Manager node as well.
    Because i did not added cloudera manager node in host list while
    deloying cluster.

    logs..please help me here.

    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 574, in
    send_heartbeat
    response = self.requestor.request('heartbeat',
    dict(request=heartbeat))
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 145, in request
    return self.issue_request(call_request, message_name, request_datum)
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 256, in issue_request
    call_response = self.transceiver.transceive(call_request)
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 485, in transceive
    result = self.read_framed_message()
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 491, in read_framed_message
    framed_message = response_reader.read_framed_message()
    File
    "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py",
    line 419, in read_framed_message
    raise ConnectionClosedException("Reader read 0 bytes.")
    ConnectionClosedException: Reader read 0 bytes.

    So, there *is* an agent running there, but it's having trouble
    heartbeating.
    Look at /etc/cloudera-scm-agent/config.ini. Is it the same as the other
    hosts? Is the server_host configured? Is the cloudera-manager-agent
    package the same version as everywhere else? One of those things (followed
    by a "service cloudera-scm-agent restart") will do the trick.

    -- Philip
    thanks
    Chittu

    On Thu, Nov 15, 2012 at 1:24 PM, Philip Zeyliger <philip@cloudera.com>
    wrote:
    On Thu, Nov 15, 2012 at 12:40 PM, wrote:

    Hi,

    I was able to launch 50 nofe cluster using clouder manager 4.1..

    When I see the health on all nodes everything showing good except
    cloudera
    manager node, which is showing unknown.

    That typically means that the agent on that machine isn't
    heartbeating.
    Look in /var/log/cloudera-scm-agent/* to see what's going on there.

    -- Philip


    Please advise on this.

    Also do we need to install CDH4 on CM node as well. Because i did not
    added cloudera manager node in host list while deloying cluster.

    Thanks
    Chittu

    Sent from my iPhone

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedNov 15, '12 at 8:46p
activeNov 16, '12 at 4:54p
posts6
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Philip Zeyliger: 3 posts Chittu546: 3 posts

People

Translate

site design / logo © 2022 Grokbase