FAQ
Moving to scm-users which is the right list for CM questions.
On Wed, Jan 16, 2013 at 3:04 PM, Joey Echeverria wrote:
Can you send a log from one of your agents?

Also, make sure you don't have any firewalls in between the agent and
the server.

-Joey
On Wed, Jan 16, 2013 at 12:37 PM, Mike Denning wrote:
Hey All,

I'm trying to install a new 12 node cluster using cloudera manager
4.5. The install gets to the end, and fails waiting for heartbeat
form all nodes. Can someone please advise? The install log is
included below.

Thanks,
Mike


/tmp/scm_prepare_node.ZCP29301
using SSH_CLIENT to get the SCM hostname: 192.168.30.45 52427 22
opening logging file descriptor
Starting installation script...
Acquiring installation lock...
BEGIN flock 4
END (0)
Detecting root privileges...
effective UID is 0
Detecting distribution...
BEGIN grep Tikanga /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 5' /etc/redhat-release
CentOS release 5.8 (Final)
END (0)
/etc/redhat-release ==> CentOS 5
Detecting Cloudera Manager Server...
BEGIN host -t PTR 192.168.30.45
Host 45.30.168.192.in-addr.arpa. not found: 3(NXDOMAIN)
END (1)
BEGIN ping -c 1 192.168.30.45
PING 192.168.30.45 (192.168.30.45) 56(84) bytes of data.
64 bytes from 192.168.30.45: icmp_seq=1 ttl=64 time=0.137 ms

--- 192.168.30.45 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms
END (0)
scm server found
BEGIN which wget
/usr/bin/wget
END (0)
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/instance-id
END (1)
Installing package repositories...
validating format of repository file
/tmp/scm_prepare_node.ZCP29301/repos/rhel5/cloudera-manager.repo
installing repository file
/tmp/scm_prepare_node.ZCP29301/repos/rhel5/cloudera-manager.repo
repository file
/tmp/scm_prepare_node.ZCP29301/repos/rhel5/cloudera-manager.repo
installed
Refreshing package metadata...
BEGIN yum clean all
Loaded plugins: dellsysid, fastestmirror, security
Cleaning up Everything
Cleaning up list of fastest mirrors
END (0)
BEGIN rm -Rf /var/cache/yum/base /var/cache/yum/cloudera-manager
/var/cache/yum/dell-omsa-indep /var/cache/yum/dell-omsa-specific
/var/cache/yum/extras /var/cache/yum/updates
END (0)
BEGIN yum makecache
Loaded plugins: dellsysid, fastestmirror, security
Determining fastest mirrors
Metadata Cache Created
END (0)
Installing jdk package...
BEGIN yum info jdk
Loaded plugins: dellsysid, fastestmirror, security
Loading mirror speeds from cached hostfile
Excluding Packages in global exclude list
Finished
Available Packages
Name : jdk
Arch : x86_64
Epoch : 2000
Version : 1.6.0_31
Release : fcs
Size : 68 M
Repo : cloudera-manager
Summary : Java(TM) Platform Standard Edition Development Kit
URL : http://java.sun.com/
License : Copyright (c) 2011, Oracle and/or its affiliates. All rights
reserved. Also under other license(s) as shown at the Description
field.
Description: The Java Platform Standard Edition Development Kit (JDK) includes
: both the runtime environment (Java virtual machine, the Java
: platform classes and supporting files) and development tools
: (compilers, debuggers, tool libraries and other tools).
:
: The JDK is a development environment for building applications,
: applets and components that can be deployed with the Java Platform
: Standard Edition Runtime Environment.

END (0)
BEGIN yum list installed jdk
Loaded plugins: dellsysid, fastestmirror, security
Error: No matching Packages to list
END (1)
BEGIN yum -y install jdk.x86_64
Loaded plugins: dellsysid, fastestmirror, security
Loading mirror speeds from cached hostfile
Excluding Packages in global exclude list
Finished
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package jdk.x86_64 2000:1.6.0_31-fcs set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
jdk x86_64 2000:1.6.0_31-fcs cloudera-manager 68 M

Transaction Summary
================================================================================
Install 1 Package(s)
Upgrade 0 Package(s)

Total download size: 68 M
Downloading Packages:
warning: rpmts_HdrFromFdno: V4 DSA signature: NOKEY, key ID e8f86acd
Importing GPG key 0xE8F86ACD "Yum Maintainer <webmaster@cloudera.com>"
from http://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : jdk 1/1Unpacking JAR files...
rt.jar...
jsse.jar...
charsets.jar...
tools.jar...
localedata.jar...
plugin.jar...
javaws.jar...
deploy.jar...


Installed:
jdk.x86_64 2000:1.6.0_31-fcs

Complete!
END (0)
remote package jdk installed
Installing cloudera-manager-agent package...
BEGIN yum info cloudera-manager-agent
Loaded plugins: dellsysid, fastestmirror, security
Loading mirror speeds from cached hostfile
Excluding Packages in global exclude list
Finished
Available Packages
Name : cloudera-manager-agent
Arch : x86_64
Version : 4.4.908
Release : 1.cm450.p0.104
Size : 4.2 M
Repo : cloudera-manager
Summary : The Cloudera Manager Agent
URL : http://www.cloudera.com
License : Proprietary
Description: The Cloudera Manager Agent.
:
: The Agent is deployed to machines running services managed by
: Cloudera Manager.

END (0)
BEGIN yum list installed cloudera-manager-agent
Loaded plugins: dellsysid, fastestmirror, security
Error: No matching Packages to list
END (1)
BEGIN yum -y install cloudera-manager-agent
Loaded plugins: dellsysid, fastestmirror, security
Loading mirror speeds from cached hostfile
Excluding Packages in global exclude list
Finished
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package cloudera-manager-agent.x86_64 0:4.4.908-1.cm450.p0.104
set to be updated
--> Processing Dependency: cyrus-sasl-gssapi for package: cloudera-manager-agent
--> Running transaction check
---> Package cyrus-sasl-gssapi.x86_64 0:2.1.22-7.el5_8.1 set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
cloudera-manager-agent x86_64 4.4.908-1.cm450.p0.104 cloudera-manager 4.2 M
Installing for dependencies:
cyrus-sasl-gssapi x86_64 2.1.22-7.el5_8.1 updates 29 k

Transaction Summary
================================================================================
Install 2 Package(s)
Upgrade 0 Package(s)

Total download size: 4.2 M
Downloading Packages:
--------------------------------------------------------------------------------
Total 1.9 MB/s | 4.2 MB 00:02
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : cyrus-sasl-gssapi 1/2
Installing : cloudera-manager-agent 2/2

Installed:
cloudera-manager-agent.x86_64 0:4.4.908-1.cm450.p0.104

Dependency Installed:
cyrus-sasl-gssapi.x86_64 0:2.1.22-7.el5_8.1

Complete!
END (0)
remote package cloudera-manager-agent installed
Installing cloudera-manager-daemons package...
BEGIN yum info cloudera-manager-daemons
Loaded plugins: dellsysid, fastestmirror, security
Loading mirror speeds from cached hostfile
Excluding Packages in global exclude list
Finished
Available Packages
Name : cloudera-manager-daemons
Arch : x86_64
Version : 4.4.908
Release : 1.cm450.p0.104
Size : 118 M
Repo : cloudera-manager
Summary : Provides daemons for monitoring Hadoop and related tools.
URL : http://www.cloudera.com
License : Proprietary
Description: This package includes daemons for monitoring and managing Hadoop.

END (0)
BEGIN yum list installed cloudera-manager-daemons
Loaded plugins: dellsysid, fastestmirror, security
Error: No matching Packages to list
END (1)
BEGIN yum -y install cloudera-manager-daemons
Loaded plugins: dellsysid, fastestmirror, security
Loading mirror speeds from cached hostfile
Excluding Packages in global exclude list
Finished
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package cloudera-manager-daemons.x86_64 0:4.4.908-1.cm450.p0.104
set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
cloudera-manager-daemons x86_64 4.4.908-1.cm450.p0.104 cloudera-manager 118 M

Transaction Summary
================================================================================
Install 1 Package(s)
Upgrade 0 Package(s)

Total download size: 118 M
Downloading Packages:
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : cloudera-manager-daemons 1/1
warning: user cloudera-scm does not exist - using root
warning: group cloudera-scm does not exist - using root

Installed:
cloudera-manager-daemons.x86_64 0:4.4.908-1.cm450.p0.104

Complete!
END (0)
remote package cloudera-manager-daemons installed
Configuring Cloudera Manager Agent...
BEGIN grep server_host=192.168.30.45 /etc/cloudera-scm-agent/config.ini
END (1)
BEGIN sed -e 's/\(server_host=\).*/\1192.168.30.45/' -i
/etc/cloudera-scm-agent/config.ini
END (0)
scm agent configured
Starting Cloudera Manager Agent...
BEGIN /sbin/service cloudera-scm-agent status | grep running
END (1)
BEGIN /sbin/service cloudera-scm-agent start
Starting cloudera-scm-agent: [60G[ [0;32m OK [0;39m]
END (0)
scm agent started
Installation script completed successfully.
all done
closing logging file descriptor
1 2 3 4 5

--



--
Joey Echeverria
Principal Solutions Architect
Cloudera, Inc.


--
Joey Echeverria
Principal Solutions Architect
Cloudera, Inc.

Search Discussions

  • Casey Ching at Jan 17, 2013 at 6:13 pm
    Hi Mike,

    It could be that the agents are reporting into the server with a unexpected
    hostname. Can you take a look at the hosts tab (click the Cloudera Manager
    logo/link in the top left, then a Hosts link should be visible in the top
    bar). Do you see any hosts reporting in? If not, the agent logs are the
    place to look -- /var/log/cloudera-scm-agent/cloudera-scm-agent.{log,out}.

    Casey
    On Wed, Jan 16, 2013 at 3:05 PM, Joey Echeverria wrote:

    Moving to scm-users which is the right list for CM questions.
    On Wed, Jan 16, 2013 at 3:04 PM, Joey Echeverria wrote:
    Can you send a log from one of your agents?

    Also, make sure you don't have any firewalls in between the agent and
    the server.

    -Joey
    On Wed, Jan 16, 2013 at 12:37 PM, Mike Denning wrote:
    Hey All,

    I'm trying to install a new 12 node cluster using cloudera manager
    4.5. The install gets to the end, and fails waiting for heartbeat
    form all nodes. Can someone please advise? The install log is
    included below.

    Thanks,
    Mike


    /tmp/scm_prepare_node.ZCP29301
    using SSH_CLIENT to get the SCM hostname: 192.168.30.45 52427 22
    opening logging file descriptor
    Starting installation script...
    Acquiring installation lock...
    BEGIN flock 4
    END (0)
    Detecting root privileges...
    effective UID is 0
    Detecting distribution...
    BEGIN grep Tikanga /etc/redhat-release
    END (1)
    BEGIN grep 'CentOS release 5' /etc/redhat-release
    CentOS release 5.8 (Final)
    END (0)
    /etc/redhat-release ==> CentOS 5
    Detecting Cloudera Manager Server...
    BEGIN host -t PTR 192.168.30.45
    Host 45.30.168.192.in-addr.arpa. not found: 3(NXDOMAIN)
    END (1)
    BEGIN ping -c 1 192.168.30.45
    PING 192.168.30.45 (192.168.30.45) 56(84) bytes of data.
    64 bytes from 192.168.30.45: icmp_seq=1 ttl=64 time=0.137 ms

    --- 192.168.30.45 ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms
    END (0)
    scm server found
    BEGIN which wget
    /usr/bin/wget
    END (0)
    BEGIN wget -qO- -T 1 -t 1
    http://169.254.169.254/latest/meta-data/instance-id
    END (1)
    Installing package repositories...
    validating format of repository file
    /tmp/scm_prepare_node.ZCP29301/repos/rhel5/cloudera-manager.repo
    installing repository file
    /tmp/scm_prepare_node.ZCP29301/repos/rhel5/cloudera-manager.repo
    repository file
    /tmp/scm_prepare_node.ZCP29301/repos/rhel5/cloudera-manager.repo
    installed
    Refreshing package metadata...
    BEGIN yum clean all
    Loaded plugins: dellsysid, fastestmirror, security
    Cleaning up Everything
    Cleaning up list of fastest mirrors
    END (0)
    BEGIN rm -Rf /var/cache/yum/base /var/cache/yum/cloudera-manager
    /var/cache/yum/dell-omsa-indep /var/cache/yum/dell-omsa-specific
    /var/cache/yum/extras /var/cache/yum/updates
    END (0)
    BEGIN yum makecache
    Loaded plugins: dellsysid, fastestmirror, security
    Determining fastest mirrors
    Metadata Cache Created
    END (0)
    Installing jdk package...
    BEGIN yum info jdk
    Loaded plugins: dellsysid, fastestmirror, security
    Loading mirror speeds from cached hostfile
    Excluding Packages in global exclude list
    Finished
    Available Packages
    Name : jdk
    Arch : x86_64
    Epoch : 2000
    Version : 1.6.0_31
    Release : fcs
    Size : 68 M
    Repo : cloudera-manager
    Summary : Java(TM) Platform Standard Edition Development Kit
    URL : http://java.sun.com/
    License : Copyright (c) 2011, Oracle and/or its affiliates. All rights
    reserved. Also under other license(s) as shown at the Description
    field.
    Description: The Java Platform Standard Edition Development Kit (JDK)
    includes
    : both the runtime environment (Java virtual machine, the Java
    : platform classes and supporting files) and development tools
    : (compilers, debuggers, tool libraries and other tools).
    :
    : The JDK is a development environment for building applications,
    : applets and components that can be deployed with the Java Platform
    : Standard Edition Runtime Environment.

    END (0)
    BEGIN yum list installed jdk
    Loaded plugins: dellsysid, fastestmirror, security
    Error: No matching Packages to list
    END (1)
    BEGIN yum -y install jdk.x86_64
    Loaded plugins: dellsysid, fastestmirror, security
    Loading mirror speeds from cached hostfile
    Excluding Packages in global exclude list
    Finished
    Setting up Install Process
    Resolving Dependencies
    --> Running transaction check
    ---> Package jdk.x86_64 2000:1.6.0_31-fcs set to be updated
    --> Finished Dependency Resolution

    Dependencies Resolved
    ================================================================================
    Package Arch Version Repository Size
    ================================================================================
    Installing:
    jdk x86_64 2000:1.6.0_31-fcs cloudera-manager 68 M

    Transaction Summary
    ================================================================================
    Install 1 Package(s)
    Upgrade 0 Package(s)

    Total download size: 68 M
    Downloading Packages:
    warning: rpmts_HdrFromFdno: V4 DSA signature: NOKEY, key ID e8f86acd
    Importing GPG key 0xE8F86ACD "Yum Maintainer <webmaster@cloudera.com>"
    from http://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera
    Running rpm_check_debug
    Running Transaction Test
    Finished Transaction Test
    Transaction Test Succeeded
    Running Transaction
    Installing : jdk 1/1Unpacking JAR files...
    rt.jar...
    jsse.jar...
    charsets.jar...
    tools.jar...
    localedata.jar...
    plugin.jar...
    javaws.jar...
    deploy.jar...


    Installed:
    jdk.x86_64 2000:1.6.0_31-fcs

    Complete!
    END (0)
    remote package jdk installed
    Installing cloudera-manager-agent package...
    BEGIN yum info cloudera-manager-agent
    Loaded plugins: dellsysid, fastestmirror, security
    Loading mirror speeds from cached hostfile
    Excluding Packages in global exclude list
    Finished
    Available Packages
    Name : cloudera-manager-agent
    Arch : x86_64
    Version : 4.4.908
    Release : 1.cm450.p0.104
    Size : 4.2 M
    Repo : cloudera-manager
    Summary : The Cloudera Manager Agent
    URL : http://www.cloudera.com
    License : Proprietary
    Description: The Cloudera Manager Agent.
    :
    : The Agent is deployed to machines running services managed by
    : Cloudera Manager.

    END (0)
    BEGIN yum list installed cloudera-manager-agent
    Loaded plugins: dellsysid, fastestmirror, security
    Error: No matching Packages to list
    END (1)
    BEGIN yum -y install cloudera-manager-agent
    Loaded plugins: dellsysid, fastestmirror, security
    Loading mirror speeds from cached hostfile
    Excluding Packages in global exclude list
    Finished
    Setting up Install Process
    Resolving Dependencies
    --> Running transaction check
    ---> Package cloudera-manager-agent.x86_64 0:4.4.908-1.cm450.p0.104
    set to be updated
    --> Processing Dependency: cyrus-sasl-gssapi for package:
    cloudera-manager-agent
    --> Running transaction check
    ---> Package cyrus-sasl-gssapi.x86_64 0:2.1.22-7.el5_8.1 set to be
    updated
    --> Finished Dependency Resolution

    Dependencies Resolved
    ================================================================================
    Package Arch Version Repository Size
    ================================================================================
    Installing:
    cloudera-manager-agent x86_64 4.4.908-1.cm450.p0.104 cloudera-manager
    4.2 M
    Installing for dependencies:
    cyrus-sasl-gssapi x86_64 2.1.22-7.el5_8.1 updates 29 k

    Transaction Summary
    ================================================================================
    Install 2 Package(s)
    Upgrade 0 Package(s)

    Total download size: 4.2 M
    Downloading Packages:
    --------------------------------------------------------------------------------
    Total 1.9 MB/s | 4.2 MB 00:02
    Running rpm_check_debug
    Running Transaction Test
    Finished Transaction Test
    Transaction Test Succeeded
    Running Transaction
    Installing : cyrus-sasl-gssapi 1/2
    Installing : cloudera-manager-agent 2/2

    Installed:
    cloudera-manager-agent.x86_64 0:4.4.908-1.cm450.p0.104

    Dependency Installed:
    cyrus-sasl-gssapi.x86_64 0:2.1.22-7.el5_8.1

    Complete!
    END (0)
    remote package cloudera-manager-agent installed
    Installing cloudera-manager-daemons package...
    BEGIN yum info cloudera-manager-daemons
    Loaded plugins: dellsysid, fastestmirror, security
    Loading mirror speeds from cached hostfile
    Excluding Packages in global exclude list
    Finished
    Available Packages
    Name : cloudera-manager-daemons
    Arch : x86_64
    Version : 4.4.908
    Release : 1.cm450.p0.104
    Size : 118 M
    Repo : cloudera-manager
    Summary : Provides daemons for monitoring Hadoop and related tools.
    URL : http://www.cloudera.com
    License : Proprietary
    Description: This package includes daemons for monitoring and managing
    Hadoop.
    END (0)
    BEGIN yum list installed cloudera-manager-daemons
    Loaded plugins: dellsysid, fastestmirror, security
    Error: No matching Packages to list
    END (1)
    BEGIN yum -y install cloudera-manager-daemons
    Loaded plugins: dellsysid, fastestmirror, security
    Loading mirror speeds from cached hostfile
    Excluding Packages in global exclude list
    Finished
    Setting up Install Process
    Resolving Dependencies
    --> Running transaction check
    ---> Package cloudera-manager-daemons.x86_64 0:4.4.908-1.cm450.p0.104
    set to be updated
    --> Finished Dependency Resolution

    Dependencies Resolved
    ================================================================================
    Package Arch Version Repository Size
    ================================================================================
    Installing:
    cloudera-manager-daemons x86_64 4.4.908-1.cm450.p0.104 cloudera-manager
    118 M
    Transaction Summary
    ================================================================================
    Install 1 Package(s)
    Upgrade 0 Package(s)

    Total download size: 118 M
    Downloading Packages:
    Running rpm_check_debug
    Running Transaction Test
    Finished Transaction Test
    Transaction Test Succeeded
    Running Transaction
    Installing : cloudera-manager-daemons 1/1
    warning: user cloudera-scm does not exist - using root
    warning: group cloudera-scm does not exist - using root

    Installed:
    cloudera-manager-daemons.x86_64 0:4.4.908-1.cm450.p0.104

    Complete!
    END (0)
    remote package cloudera-manager-daemons installed
    Configuring Cloudera Manager Agent...
    BEGIN grep server_host=192.168.30.45 /etc/cloudera-scm-agent/config.ini
    END (1)
    BEGIN sed -e 's/\(server_host=\).*/\1192.168.30.45/' -i
    /etc/cloudera-scm-agent/config.ini
    END (0)
    scm agent configured
    Starting Cloudera Manager Agent...
    BEGIN /sbin/service cloudera-scm-agent status | grep running
    END (1)
    BEGIN /sbin/service cloudera-scm-agent start
    Starting cloudera-scm-agent: [60G[ [0;32m OK [0;39m]
    END (0)
    scm agent started
    Installation script completed successfully.
    all done
    closing logging file descriptor
    1 2 3 4 5

    --



    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedJan 16, '13 at 11:05p
activeJan 17, '13 at 6:13p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Casey Ching: 1 post Joey Echeverria: 1 post

People

Translate

site design / logo © 2022 Grokbase