FAQ
I ran into following errors while I was adding additional hosts to the
cluster.

Installation failed. Failed to receive heartbeat from agent.

    - Ensure that the host's hostname is configured properly.
    - Ensure that port 7182 is accessible on the Cloudera Manager server
    (check firewall rules).
    - Ensure that ports 9000 and 9001 are free on the host being added.
    - Check agent logs in /var/log/cloudera-scm-agent/ on the host being
    added (some of the logs can be found in the installation details).

System Admin verified that there are no port/firewall issues.

I have attached log here, I don't see any ERROR or I couldn't notice.
Looks like I am missing something, it would be great if someone can guide
me here.

/tmp/scm_prepare_node.qBLI2QmT
using SSH_CLIENT to get the SCM hostname: 10.2.1.450 61688 22
opening logging file descriptor
Starting installation script...
Acquiring installation lock...
BEGIN flock 4
END (0)
Detecting root privileges...
effective UID is 0
Detecting distribution...
BEGIN grep Tikanga /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 5' /etc/redhat-release
END (1)
BEGIN grep 'Scientific Linux release 5' /etc/redhat-release
END (1)
BEGIN grep Santiago /etc/redhat-release
END (1)
BEGIN grep 'CentOS Linux release 6' /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 6' /etc/redhat-release
CentOS release 6.3 (Final)
END (0)
/etc/redhat-release ==> CentOS 6
Detecting Cloudera Manager Server...
BEGIN host -t PTR 10.2.1.450
230.1.2.10.in-addr.arpa domain name pointer cmhost.
END (0)
using cmhost as scm server hostname
BEGIN perl -e 'use IO::Socket; exit(not (new IO::Socket::INET(PeerAddr =>
@ARGV[0], PeerPort => @ARGV[1], Proto => tcp, Timeout => 5)));' cmhost 7182
END (0)
scm server found
BEGIN which wget
/usr/bin/wget
END (0)
BEGIN wget -qO- -T 1 -t 1
http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo
END (4)
Installing package repositories...
validating format of repository file
/tmp/scm_prepare_node.qBLI2QmT/repos/rhel6/cloudera-manager.repo
installing repository file
/tmp/scm_prepare_node.qBLI2QmT/repos/rhel6/cloudera-manager.repo
repository file
/tmp/scm_prepare_node.qBLI2QmT/repos/rhel6/cloudera-manager.repo installed
Refreshing package metadata...
BEGIN yum clean all
Loaded plugins: fastestmirror, security
Cleaning repos: cloudera-cdh4 cloudera-manager techops-base techops-extras
: techops-updates
Cleaning up Everything
Cleaning up list of fastest mirrors
END (0)
BEGIN rm -Rf /var/cache/yum/x86_64
END (0)
BEGIN yum makecache
Loaded plugins: fastestmirror, security
Metadata Cache Created
END (0)
Installing jdk package...
BEGIN yum list installed jdk
Loaded plugins: fastestmirror, security
Installed Packages
jdk.x86_64 2000:1.7.0_17-fcs @techops-updates
END (0)
BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep jdk
jdk cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info jdk
Loaded plugins: fastestmirror, security
Determining fastest mirrors
Installed Packages
Name : jdk
Arch : x86_64
Epoch : 2000
Version : 1.7.0_17
Release : fcs
Size : 161 M
Repo : installed
From repo : techops-updates
Summary : Java Platform Standard Edition Development Kit
URL : URL_REF
License : http://java.com/license
Description : The Java Platform Standard Edition Development Kit (JDK)
includes
: both the runtime environment (Java virtual machine, the Java
: platform classes and supporting files) and development tools
: (compilers, debuggers, tool libraries and other tools).
:
: The JDK is a development environment for building applications,
: applets and components that can be deployed with the Java Platform
: Standard Edition Runtime Environment.

END (0)
BEGIN yum -y install jdk.x86_64
Loaded plugins: fastestmirror, security
Loading mirror speeds from cached hostfile
Setting up Install Process
Package 2000:jdk-1.7.0_17-fcs.x86_64 already installed and latest version
Nothing to do
END (0)
remote package jdk installed
Installing cloudera-manager-agent package...
BEGIN yum list installed cloudera-manager-agent
Loaded plugins: fastestmirror, security
Installed Packages
cloudera-manager-agent.x86_64 4.5.2-1.cm452.p0.327 @cloudera-manager
END (0)
BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
cloudera-manager-agent
jdk cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info cloudera-manager-agent
Loaded plugins: fastestmirror, security
Loading mirror speeds from cached hostfile
Installed Packages
Name : cloudera-manager-agent
Arch : x86_64
Version : 4.5.2
Release : 1.cm452.p0.327
Size : 24 M
Repo : installed
From repo : cloudera-manager
Summary : The Cloudera Manager Agent
URL : http://www.cloudera.com
License : Proprietary
Description : The Cloudera Manager Agent.
:
: The Agent is deployed to machines running services managed by
: Cloudera Manager.

END (0)
Version : 4.5.2
Release : 1.cm452.p0.327
BEGIN yum -y install cloudera-manager-agent
Loaded plugins: fastestmirror, security
Loading mirror speeds from cached hostfile
Setting up Install Process
Package cloudera-manager-agent-4.5.2-1.cm452.p0.327.x86_64 already
installed and latest version
Nothing to do
END (0)
remote package cloudera-manager-agent installed
Installing cloudera-manager-daemons package...
BEGIN yum list installed cloudera-manager-daemons
Loaded plugins: fastestmirror, security
Installed Packages
cloudera-manager-daemons.x86_64 4.5.2-1.cm452.p0.327 @cloudera-manager
END (0)
BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
cloudera-manager-daemons
jdk cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info cloudera-manager-daemons
Loaded plugins: fastestmirror, security
Loading mirror speeds from cached hostfile
Installed Packages
Name : cloudera-manager-daemons
Arch : x86_64
Version : 4.5.2
Release : 1.cm452.p0.327
Size : 166 M
Repo : installed
From repo : cloudera-manager
Summary : Provides daemons for monitoring Hadoop and related tools.
URL : http://www.cloudera.com
License : Proprietary
Description : This package includes daemons for monitoring and managing
Hadoop.

END (0)
Version : 4.5.2
Release : 1.cm452.p0.327
BEGIN yum -y install cloudera-manager-daemons
Loaded plugins: fastestmirror, security
Loading mirror speeds from cached hostfile
Setting up Install Process
Package cloudera-manager-daemons-4.5.2-1.cm452.p0.327.x86_64 already
installed and latest version
Nothing to do
END (0)
remote package cloudera-manager-daemons installed
Configuring Cloudera Manager Agent...
BEGIN grep server_host=cmhost /etc/cloudera-scm-agent/config.ini
server_host=cmhost-eth0
END (0)
scm agent is already configured
Starting Cloudera Manager Agent...
BEGIN /sbin/service cloudera-scm-agent status | grep running
cloudera-scm-agent (pid 9448) is running...
END (0)
BEGIN /sbin/service cloudera-scm-agent restart
Stopping cloudera-scm-agent: [ OK ]
Starting cloudera-scm-agent: [ OK ]
END (0)
agent logs:
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed
's/^/>>/'
/usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha
module is deprecated; use the hashlib module instead
import sha
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO SCM Agent
Version: 4.5.2
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Missing database
jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using
this database type)
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Missing database
jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using
this database type)
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Found database
jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using directory:
/var/run/cloudera-scm-agent
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using supervisor
binary path: /usr/lib64/cmf/agent/src/cmf/../../build/env/bin/supervisord
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Adding env vars
that start with CMF_AGENT_
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: HIVE_DEFAULT_XML:
/etc/hive/conf.dist/hive-default.xml
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: MGMT_HOME: /usr/share/cmf
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HTTPFS_HOME: /usr/lib/hadoop-httpfs
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_FLUME_HOME: /usr/lib/flume-ng
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HBASE_HOME: /usr/lib/hbase
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HUE_HOME: /usr/share/hue
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: TOMCAT_HOME: /usr/lib/bigtop-tomcat
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_PIG_HOME: /usr/lib/pig
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HIVE_HOME: /usr/lib/hive
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_YARN_HOME: /usr/lib/hadoop-yarn
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HADOOP_BIN: /usr/bin/hadoop
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_OOZIE_HOME: /usr/lib/oozie
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_ZOOKEEPER_HOME: /usr/lib/zookeeper
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HUE_PLUGINS_HOME: /usr/lib/hadoop
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: JSVC_HOME: /usr/libexec/bigtop-utils
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HDFS_HOME: /usr/lib/hadoop-hdfs
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_MR1_HOME: /usr/lib/hadoop-0.20-mapreduce
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_MR2_HOME: /usr/lib/hadoop-mapreduce
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HADOOP_HOME: /usr/lib/hadoop
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_IMPALA_HOME: /usr/lib/impala
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Logging to
/var/log/cloudera-scm-agent/cloudera-scm-agent.log
/usr/lib64/cmf/agent/src/cmf/agent.py:498: DeprecationWarning:
psutil.used_phymem is deprecated; use psutil.phymem_usage instead
really_used = psutil.used_phymem() - cached - buffers
/usr/lib64/cmf/agent/src/cmf/agent.py:500: DeprecationWarning:
psutil.total_virtmem is deprecated; use psutil.virtmem_usage instead
stats["virtual_memory_total"] = psutil.total_virtmem()
/usr/lib64/cmf/agent/src/cmf/agent.py:501: DeprecationWarning:
psutil.used_virtmem is deprecated; use psutil.virtmem_usage instead
stats["virtual_memory_used"] = psutil.used_virtmem()
/usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha
module is deprecated; use the hashlib module instead
import sha
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO SCM Agent
Version: 4.5.2
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Missing database
jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using
this database type)
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Missing database
jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using
this database type)
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Found database
jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using directory:
/var/run/cloudera-scm-agent
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using supervisor
binary path: /usr/lib64/cmf/agent/src/cmf/../../build/env/bin/supervisord
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Adding env vars
that start with CMF_AGENT_
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: HIVE_DEFAULT_XML:
/etc/hive/conf.dist/hive-default.xml
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: MGMT_HOME: /usr/share/cmf
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HTTPFS_HOME: /usr/lib/hadoop-httpfs
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_FLUME_HOME: /usr/lib/flume-ng
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HBASE_HOME: /usr/lib/hbase
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HUE_HOME: /usr/share/hue
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: TOMCAT_HOME: /usr/lib/bigtop-tomcat
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_PIG_HOME: /usr/lib/pig
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HIVE_HOME: /usr/lib/hive
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_YARN_HOME: /usr/lib/hadoop-yarn
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HADOOP_BIN: /usr/bin/hadoop
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_OOZIE_HOME: /usr/lib/oozie
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_ZOOKEEPER_HOME: /usr/lib/zookeeper
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HUE_PLUGINS_HOME: /usr/lib/hadoop
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: JSVC_HOME: /usr/libexec/bigtop-utils
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HDFS_HOME: /usr/lib/hadoop-hdfs
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_MR1_HOME: /usr/lib/hadoop-0.20-mapreduce
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_MR2_HOME: /usr/lib/hadoop-mapreduce
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_HADOOP_HOME: /usr/lib/hadoop
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
passing env var to supervisee: CDH_IMPALA_HOME: /usr/lib/impala
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Logging to
/var/log/cloudera-scm-agent/cloudera-scm-agent.log
/usr/lib64/cmf/agent/src/cmf/agent.py:498: DeprecationWarning:
psutil.used_phymem is deprecated; use psutil.phymem_usage instead
really_used = psutil.used_phymem() - cached - buffers
/usr/lib64/cmf/agent/src/cmf/agent.py:500: DeprecationWarning:
psutil.total_virtmem is deprecated; use psutil.virtmem_usage instead
stats["virtual_memory_total"] = psutil.total_virtmem()
/usr/lib64/cmf/agent/src/cmf/agent.py:501: DeprecationWarning:
psutil.used_virtmem is deprecated; use psutil.virtmem_usage instead
stats["virtual_memory_used"] = psutil.used_virtmem()
END (0)
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed
's/^/>>/'
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO No cgrouped
processes running; unmounting any cgroup roots
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO No processes are
being managed; Supervisor will shutdown.
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Shutting down
supervisord, pid 9468
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Successfully
shutdown supervisord, pid 9468
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus STOPPING
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('cshdp15', 9000)) shut down
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Stopped thread '_TimeoutMonitor'.
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus STOPPED
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus STOPPING
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('cshdp15', 9000)) already shut down
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE No thread running for None.
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus STOPPED
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus EXITING
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus EXITED
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Agent exiting;
caught signal 15
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO No command line
vars
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Agent starting as
pid 9661 user root(0) group root(0).
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent
[08/Aug/2013 09:03:05 +0000] 9661 MainThread downloader INFO Downloader
path: /opt/cloudera/parcel-cache
[08/Aug/2013 09:03:05 +0000] 9661 MainThread parcel_cache INFO Using
/opt/cloudera/parcel-cache for parcel cache
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent/cgroups
[08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
/var/run/cloudera-scm-agent/cgroups/memory
[08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
/var/run/cloudera-scm-agent/cgroups/cpu
[08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
/var/run/cloudera-scm-agent/cgroups/blkio
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Found cgroups
capabilities: {'has_memory': True, 'default_memory_limit_in_bytes':
9223372036854775807, 'writable_cgroup_dot_procs': True, 'has_cpu': True,
'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_blkio':
True}
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Setting up
supervisord event monitor.
[08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO
Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
timeout of 2.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
join timeout of 0.100000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
tolerance of 60.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
metrics_url_timeout_seconds of 30.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
task_metrics_timeout_seconds of 5.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
max_collection_wait_seconds of 10.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread metrics INFO Importing
tasktracker metric schema from file
/usr/lib64/cmf/agent/src/cmf/monitor/tasktracker/schema.json
[08/Aug/2013 09:03:05 +0000] 9661 MainThread __init__ INFO Importing
metric schema from file /usr/lib64/cmf/agent/src/cmf/monitor/schema.json
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Supervised
processes will inherit the following environment: {'CMF_CONF_DIR':
'/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
'/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
'/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CMF_AGENT_CDH_FLUME_HOME':
'/usr/lib/flume-ng', 'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG':
'en_US.UTF-8', 'TERM': 'vt100', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
'/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
'/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
'/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
'/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
'/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
'/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
'/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
'/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Supervised
processes will add the following their environment environment:
{'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
'/usr/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
'/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
'/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
'/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
'/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
'/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent/process
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent/supervisor
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent/supervisor/include
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Failed to connect
to previous supervisor.
[08/Aug/2013 09:03:08 +0000] 9661 MainThread agent INFO Trying to connect
to newly launched supervisor (Attempt 1)
[08/Aug/2013 09:03:08 +0000] 9661 MainThread agent INFO Successfully
connected to supervisor
[08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
[08/Aug/2013:09:03:08] ENGINE Bus STARTING
[08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
[08/Aug/2013:09:03:08] ENGINE Started monitor thread '_TimeoutMonitor'.
[08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
[08/Aug/2013:09:03:08] ENGINE Serving on cshdp15:9000
[08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
[08/Aug/2013:09:03:08] ENGINE Bus STARTED
[08/Aug/2013 09:03:08 +0000] 9661 MainThread __init__ INFO New monitor:
(<cmf.monitor.host.hostmonitor object@0x2575910>,)
[08/Aug/2013 09:03:08 +0000] 9661 MonitorDaemon-Scheduler __init__ INFO
Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
0x2575910>,)
[08/Aug/2013 09:03:08 +0000] 9661 MainThread agent WARNING Setting
default socket timeout to 30!
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO No cgrouped
processes running; unmounting any cgroup roots
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO No processes are
being managed; Supervisor will shutdown.
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Shutting down
supervisord, pid 9468
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Successfully
shutdown supervisord, pid 9468
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus STOPPING
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('cshdp15', 9000)) shut down
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Stopped thread '_TimeoutMonitor'.
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus STOPPED
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus STOPPING
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('cshdp15', 9000)) already shut down
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE No thread running for None.
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus STOPPED
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus EXITING
[08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
[08/Aug/2013:09:03:03] ENGINE Bus EXITED
[08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Agent exiting;
caught signal 15
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO No command line
vars
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Agent starting as
pid 9661 user root(0) group root(0).
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent
[08/Aug/2013 09:03:05 +0000] 9661 MainThread downloader INFO Downloader
path: /opt/cloudera/parcel-cache
[08/Aug/2013 09:03:05 +0000] 9661 MainThread parcel_cache INFO Using
/opt/cloudera/parcel-cache for parcel cache
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent/cgroups
[08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
/var/run/cloudera-scm-agent/cgroups/memory
[08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
/var/run/cloudera-scm-agent/cgroups/cpu
[08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
/var/run/cloudera-scm-agent/cgroups/blkio
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Found cgroups
capabilities: {'has_memory': True, 'default_memory_limit_in_bytes':
9223372036854775807, 'writable_cgroup_dot_procs': True, 'has_cpu': True,
'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_blkio':
True}
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Setting up
supervisord event monitor.
[08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO
Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
timeout of 2.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
join timeout of 0.100000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
tolerance of 60.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
metrics_url_timeout_seconds of 30.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
task_metrics_timeout_seconds of 5.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
max_collection_wait_seconds of 10.000000
[08/Aug/2013 09:03:05 +0000] 9661 MainThread metrics INFO Importing
tasktracker metric schema from file
/usr/lib64/cmf/agent/src/cmf/monitor/tasktracker/schema.json
[08/Aug/2013 09:03:05 +0000] 9661 MainThread __init__ INFO Importing
metric schema from file /usr/lib64/cmf/agent/src/cmf/monitor/schema.json
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Supervised
processes will inherit the following environment: {'CMF_CONF_DIR':
'/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
'/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
'/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CMF_AGENT_CDH_FLUME_HOME':
'/usr/lib/flume-ng', 'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG':
'en_US.UTF-8', 'TERM': 'vt100', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
'/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
'/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
'/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
'/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
'/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
'/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
'/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
'/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Supervised
processes will add the following their environment environment:
{'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
'/usr/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
'/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
'/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
'/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
'/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
'/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent/process
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent/supervisor
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
pre-existing directory: /var/run/cloudera-scm-agent/supervisor/include
[08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Failed to connect
to previous supervisor.
[08/Aug/2013 09:03:08 +0000] 9661 MainThread agent INFO Trying to connect
to newly launched supervisor (Attempt 1)
[08/Aug/2013 09:03:08 +0000] 9661 MainThread agent INFO Successfully
connected to supervisor
[08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
[08/Aug/2013:09:03:08] ENGINE Bus STARTING
[08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
[08/Aug/2013:09:03:08] ENGINE Started monitor thread '_TimeoutMonitor'.
[08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
[08/Aug/2013:09:03:08] ENGINE Serving on cshdp15:9000
[08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
[08/Aug/2013:09:03:08] ENGINE Bus STARTED
[08/Aug/2013 09:03:08 +0000] 9661 MainThread __init__ INFO New monitor:
(<cmf.monitor.host.hostmonitor object@0x2575910>,)
[08/Aug/2013 09:03:08 +0000] 9661 MonitorDaemon-Scheduler __init__ INFO
Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
0x2575910>,)
[08/Aug/2013 09:03:08 +0000] 9661 MainThread agent WARNING Setting
default socket timeout to 30!
END (0)
end of agent logs.
scm agent restarted
Installation script completed successfully.
all done
closing logging file descriptor







1 2 3 4 5 6 7

Search Discussions

  • Herman Chen at Aug 8, 2013 at 6:53 pm
    Hi

    If you are sure there's no firewall issue, then hostname configuration
    issue is most likely. You can follow
    http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Installation-Guide/cdh4ig_topic_11_1.html

    Also make sure no other processes have taken up port 9000 and 9001. If all
    else fail, please attach the complete agent log.

    Herman

    On Thu, Aug 8, 2013 at 10:59 AM, Mani wrote:

    I ran into following errors while I was adding additional hosts to the
    cluster.

    Installation failed. Failed to receive heartbeat from agent.

    - Ensure that the host's hostname is configured properly.
    - Ensure that port 7182 is accessible on the Cloudera Manager server
    (check firewall rules).
    - Ensure that ports 9000 and 9001 are free on the host being added.
    - Check agent logs in /var/log/cloudera-scm-agent/ on the host being
    added (some of the logs can be found in the installation details).

    System Admin verified that there are no port/firewall issues.

    I have attached log here, I don't see any ERROR or I couldn't notice.
    Looks like I am missing something, it would be great if someone can guide
    me here.

    /tmp/scm_prepare_node.qBLI2QmT
    using SSH_CLIENT to get the SCM hostname: 10.2.1.450 61688 22
    opening logging file descriptor
    Starting installation script...
    Acquiring installation lock...
    BEGIN flock 4
    END (0)
    Detecting root privileges...
    effective UID is 0
    Detecting distribution...
    BEGIN grep Tikanga /etc/redhat-release
    END (1)
    BEGIN grep 'CentOS release 5' /etc/redhat-release
    END (1)
    BEGIN grep 'Scientific Linux release 5' /etc/redhat-release
    END (1)
    BEGIN grep Santiago /etc/redhat-release
    END (1)
    BEGIN grep 'CentOS Linux release 6' /etc/redhat-release
    END (1)
    BEGIN grep 'CentOS release 6' /etc/redhat-release
    CentOS release 6.3 (Final)
    END (0)
    /etc/redhat-release ==> CentOS 6
    Detecting Cloudera Manager Server...
    BEGIN host -t PTR 10.2.1.450
    230.1.2.10.in-addr.arpa domain name pointer cmhost.
    END (0)
    using cmhost as scm server hostname
    BEGIN perl -e 'use IO::Socket; exit(not (new IO::Socket::INET(PeerAddr =>
    @ARGV[0], PeerPort => @ARGV[1], Proto => tcp, Timeout => 5)));' cmhost 7182
    END (0)
    scm server found
    BEGIN which wget
    /usr/bin/wget
    END (0)
    BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/**
    meta-data/public-hostname<http://169.254.169.254/latest/meta-data/public-hostname>&& /bin/echo
    END (4)
    Installing package repositories...
    validating format of repository file /tmp/scm_prepare_node.**
    qBLI2QmT/repos/rhel6/cloudera-**manager.repo
    installing repository file /tmp/scm_prepare_node.**
    qBLI2QmT/repos/rhel6/cloudera-**manager.repo
    repository file /tmp/scm_prepare_node.**qBLI2QmT/repos/rhel6/cloudera-**manager.repo
    installed
    Refreshing package metadata...
    BEGIN yum clean all
    Loaded plugins: fastestmirror, security
    Cleaning repos: cloudera-cdh4 cloudera-manager techops-base techops-extras
    : techops-updates
    Cleaning up Everything
    Cleaning up list of fastest mirrors
    END (0)
    BEGIN rm -Rf /var/cache/yum/x86_64
    END (0)
    BEGIN yum makecache
    Loaded plugins: fastestmirror, security
    Metadata Cache Created
    END (0)
    Installing jdk package...
    BEGIN yum list installed jdk
    Loaded plugins: fastestmirror, security
    Installed Packages
    jdk.x86_64 2000:1.7.0_17-fcs @techops-updates
    END (0)
    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep jdk
    jdk cloudera-manager-agent cloudera-manager-daemons
    END (0)
    BEGIN yum info jdk
    Loaded plugins: fastestmirror, security
    Determining fastest mirrors
    Installed Packages
    Name : jdk
    Arch : x86_64
    Epoch : 2000
    Version : 1.7.0_17
    Release : fcs
    Size : 161 M
    Repo : installed
    From repo : techops-updates
    Summary : Java Platform Standard Edition Development Kit
    URL : URL_REF
    License : http://java.com/license
    Description : The Java Platform Standard Edition Development Kit (JDK)
    includes
    : both the runtime environment (Java virtual machine, the Java
    : platform classes and supporting files) and development tools
    : (compilers, debuggers, tool libraries and other tools).
    :
    : The JDK is a development environment for building applications,
    : applets and components that can be deployed with the Java Platform
    : Standard Edition Runtime Environment.

    END (0)
    BEGIN yum -y install jdk.x86_64
    Loaded plugins: fastestmirror, security
    Loading mirror speeds from cached hostfile
    Setting up Install Process
    Package 2000:jdk-1.7.0_17-fcs.x86_64 already installed and latest version
    Nothing to do
    END (0)
    remote package jdk installed
    Installing cloudera-manager-agent package...
    BEGIN yum list installed cloudera-manager-agent
    Loaded plugins: fastestmirror, security
    Installed Packages
    cloudera-manager-agent.x86_64 4.5.2-1.cm452.p0.327 @cloudera-manager
    END (0)
    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
    cloudera-manager-agent
    jdk cloudera-manager-agent cloudera-manager-daemons
    END (0)
    BEGIN yum info cloudera-manager-agent
    Loaded plugins: fastestmirror, security
    Loading mirror speeds from cached hostfile
    Installed Packages
    Name : cloudera-manager-agent
    Arch : x86_64
    Version : 4.5.2
    Release : 1.cm452.p0.327
    Size : 24 M
    Repo : installed
    From repo : cloudera-manager
    Summary : The Cloudera Manager Agent
    URL : http://www.cloudera.com
    License : Proprietary
    Description : The Cloudera Manager Agent.
    :
    : The Agent is deployed to machines running services managed by
    : Cloudera Manager.

    END (0)
    Version : 4.5.2
    Release : 1.cm452.p0.327
    BEGIN yum -y install cloudera-manager-agent
    Loaded plugins: fastestmirror, security
    Loading mirror speeds from cached hostfile
    Setting up Install Process
    Package cloudera-manager-agent-4.5.2-**1.cm452.p0.327.x86_64 already
    installed and latest version
    Nothing to do
    END (0)
    remote package cloudera-manager-agent installed
    Installing cloudera-manager-daemons package...
    BEGIN yum list installed cloudera-manager-daemons
    Loaded plugins: fastestmirror, security
    Installed Packages
    cloudera-manager-daemons.x86_**64 4.5.2-1.cm452.p0.327 @cloudera-manager
    END (0)
    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
    cloudera-manager-daemons
    jdk cloudera-manager-agent cloudera-manager-daemons
    END (0)
    BEGIN yum info cloudera-manager-daemons
    Loaded plugins: fastestmirror, security
    Loading mirror speeds from cached hostfile
    Installed Packages
    Name : cloudera-manager-daemons
    Arch : x86_64
    Version : 4.5.2
    Release : 1.cm452.p0.327
    Size : 166 M
    Repo : installed
    From repo : cloudera-manager
    Summary : Provides daemons for monitoring Hadoop and related tools.
    URL : http://www.cloudera.com
    License : Proprietary
    Description : This package includes daemons for monitoring and managing
    Hadoop.

    END (0)
    Version : 4.5.2
    Release : 1.cm452.p0.327
    BEGIN yum -y install cloudera-manager-daemons
    Loaded plugins: fastestmirror, security
    Loading mirror speeds from cached hostfile
    Setting up Install Process
    Package cloudera-manager-daemons-4.5.**2-1.cm452.p0.327.x86_64 already
    installed and latest version
    Nothing to do
    END (0)
    remote package cloudera-manager-daemons installed
    Configuring Cloudera Manager Agent...
    BEGIN grep server_host=cmhost /etc/cloudera-scm-agent/**config.ini
    server_host=cmhost-eth0
    END (0)
    scm agent is already configured
    Starting Cloudera Manager Agent...
    BEGIN /sbin/service cloudera-scm-agent status | grep running
    cloudera-scm-agent (pid 9448) is running...
    END (0)
    BEGIN /sbin/service cloudera-scm-agent restart
    Stopping cloudera-scm-agent: [60G[ [0;32m OK [0;39m]
    Starting cloudera-scm-agent: [60G[ [0;32m OK [0;39m]
    END (0)
    agent logs:
    BEGIN tail -n 50 /var/log/cloudera-scm-agent//**cloudera-scm-agent.out |
    sed 's/^/>>/'
    /usr/lib64/cmf/agent/src/**cmf/agent.py:31: DeprecationWarning: the sha
    module is deprecated; use the hashlib module instead
    import sha
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO SCM Agent
    Version: 4.5.2
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Missing database
    jar: /usr/share/java/mysql-**connector-java.jar (normal, if you're not
    using this database type)
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Missing database
    jar: /usr/share/java/oracle-**connector-java.jar (normal, if you're not
    using this database type)
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Found database
    jar: /usr/share/cmf/lib/postgresql-**9.0-801.jdbc4.jar
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using directory:
    /var/run/cloudera-scm-agent
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using supervisor
    binary path: /usr/lib64/cmf/agent/src/cmf/.**./../build/env/bin/supervisord
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Adding env vars
    that start with CMF_AGENT_
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: HIVE_DEFAULT_XML: /etc/hive/conf.dist/hive-
    **default.xml
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: MGMT_HOME: /usr/share/cmf
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HTTPFS_HOME: /usr/lib/hadoop-httpfs
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_FLUME_HOME: /usr/lib/flume-ng
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HBASE_HOME: /usr/lib/hbase
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HUE_HOME: /usr/share/hue
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: TOMCAT_HOME: /usr/lib/bigtop-tomcat
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_PIG_HOME: /usr/lib/pig
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HIVE_HOME: /usr/lib/hive
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_YARN_HOME: /usr/lib/hadoop-yarn
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HADOOP_BIN: /usr/bin/hadoop
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_OOZIE_HOME: /usr/lib/oozie
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_ZOOKEEPER_HOME: /usr/lib/zookeeper
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HUE_PLUGINS_HOME: /usr/lib/hadoop
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: JSVC_HOME: /usr/libexec/bigtop-utils
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HDFS_HOME: /usr/lib/hadoop-hdfs
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_MR1_HOME: /usr/lib/hadoop-0.20-mapreduce
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_MR2_HOME: /usr/lib/hadoop-mapreduce
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HADOOP_HOME: /usr/lib/hadoop
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_IMPALA_HOME: /usr/lib/impala
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Logging to
    /var/log/cloudera-scm-agent/**cloudera-scm-agent.log
    /usr/lib64/cmf/agent/src/**cmf/agent.py:498: DeprecationWarning:
    psutil.used_phymem is deprecated; use psutil.phymem_usage instead
    really_used = psutil.used_phymem() - cached - buffers
    /usr/lib64/cmf/agent/src/**cmf/agent.py:500: DeprecationWarning:
    psutil.total_virtmem is deprecated; use psutil.virtmem_usage instead
    stats["virtual_memory_total"] = psutil.total_virtmem()
    /usr/lib64/cmf/agent/src/**cmf/agent.py:501: DeprecationWarning:
    psutil.used_virtmem is deprecated; use psutil.virtmem_usage instead
    stats["virtual_memory_used"] = psutil.used_virtmem()
    /usr/lib64/cmf/agent/src/**cmf/agent.py:31: DeprecationWarning: the sha
    module is deprecated; use the hashlib module instead
    import sha
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO SCM Agent
    Version: 4.5.2
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Missing database
    jar: /usr/share/java/mysql-**connector-java.jar (normal, if you're not
    using this database type)
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Missing database
    jar: /usr/share/java/oracle-**connector-java.jar (normal, if you're not
    using this database type)
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Found database
    jar: /usr/share/cmf/lib/postgresql-**9.0-801.jdbc4.jar
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using directory:
    /var/run/cloudera-scm-agent
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using supervisor
    binary path: /usr/lib64/cmf/agent/src/cmf/.**./../build/env/bin/supervisord
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Adding env vars
    that start with CMF_AGENT_
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: HIVE_DEFAULT_XML: /etc/hive/conf.dist/hive-
    **default.xml
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: MGMT_HOME: /usr/share/cmf
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HTTPFS_HOME: /usr/lib/hadoop-httpfs
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_FLUME_HOME: /usr/lib/flume-ng
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HBASE_HOME: /usr/lib/hbase
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HUE_HOME: /usr/share/hue
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: TOMCAT_HOME: /usr/lib/bigtop-tomcat
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_PIG_HOME: /usr/lib/pig
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HIVE_HOME: /usr/lib/hive
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_YARN_HOME: /usr/lib/hadoop-yarn
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HADOOP_BIN: /usr/bin/hadoop
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_OOZIE_HOME: /usr/lib/oozie
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_ZOOKEEPER_HOME: /usr/lib/zookeeper
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HUE_PLUGINS_HOME: /usr/lib/hadoop
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: JSVC_HOME: /usr/libexec/bigtop-utils
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HDFS_HOME: /usr/lib/hadoop-hdfs
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_MR1_HOME: /usr/lib/hadoop-0.20-mapreduce
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_MR2_HOME: /usr/lib/hadoop-mapreduce
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_HADOOP_HOME: /usr/lib/hadoop
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO explicitly
    passing env var to supervisee: CDH_IMPALA_HOME: /usr/lib/impala
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Logging to
    /var/log/cloudera-scm-agent/**cloudera-scm-agent.log
    /usr/lib64/cmf/agent/src/**cmf/agent.py:498: DeprecationWarning:
    psutil.used_phymem is deprecated; use psutil.phymem_usage instead
    really_used = psutil.used_phymem() - cached - buffers
    /usr/lib64/cmf/agent/src/**cmf/agent.py:500: DeprecationWarning:
    psutil.total_virtmem is deprecated; use psutil.virtmem_usage instead
    stats["virtual_memory_total"] = psutil.total_virtmem()
    /usr/lib64/cmf/agent/src/**cmf/agent.py:501: DeprecationWarning:
    psutil.used_virtmem is deprecated; use psutil.virtmem_usage instead
    stats["virtual_memory_used"] = psutil.used_virtmem()
    END (0)
    BEGIN tail -n 50 /var/log/cloudera-scm-agent//**cloudera-scm-agent.log |
    sed 's/^/>>/'
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO No cgrouped
    processes running; unmounting any cgroup roots
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO No processes are
    being managed; Supervisor will shutdown.
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Shutting down
    supervisord, pid 9468
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Successfully
    shutdown supervisord, pid 9468
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus STOPPING
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE HTTP Server cherrypy._cpwsgi_server.**CPWSGIServer(('cshdp15',
    9000)) shut down
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Stopped thread '_TimeoutMonitor'.
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus STOPPED
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus STOPPING
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE HTTP Server cherrypy._cpwsgi_server.**CPWSGIServer(('cshdp15',
    9000)) already shut down
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE No thread running for None.
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus STOPPED
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus EXITING
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus EXITED
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Agent exiting;
    caught signal 15
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO No command line
    vars
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Agent starting
    as pid 9661 user root(0) group root(0).
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread downloader INFO Downloader
    path: /opt/cloudera/parcel-cache
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent/**cgroups
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
    /var/run/cloudera-scm-agent/**cgroups/memory
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
    /var/run/cloudera-scm-agent/**cgroups/cpu
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
    /var/run/cloudera-scm-agent/**cgroups/blkio
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Found cgroups
    capabilities: {'has_memory': True, 'default_memory_limit_in_**bytes':
    9223372036854775807, 'writable_cgroup_dot_procs': True, 'has_cpu': True,
    'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_blkio':
    True}
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Setting up
    supervisord event monitor.
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
    timeout of 2.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
    join timeout of 0.100000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
    tolerance of 60.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread metrics INFO Importing
    tasktracker metric schema from file /usr/lib64/cmf/agent/src/cmf/**
    monitor/tasktracker/schema.**json
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread __init__ INFO Importing
    metric schema from file /usr/lib64/cmf/agent/src/cmf/**monitor/schema.json
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Supervised
    processes will inherit the following environment: {'CMF_CONF_DIR':
    '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-**default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH': '/sbin:/usr/sbin:/bin:/usr/**bin', 'CMF_AGENT_CDH_FLUME_HOME':
    '/usr/lib/flume-ng', 'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG':
    'en_US.UTF-8', 'TERM': 'vt100', 'CLOUDERA_ORACLE_CONNECTOR_**JAR':
    '/usr/share/java/oracle-**connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR'**:
    '/usr/share/cmf/lib/**postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR'**: '/usr/share/java/mysql-
    **connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME': '/usr/lib/hadoop-yarn',
    'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop', 'CMF_AGENT_CDH_OOZIE_HOME':
    '/usr/lib/oozie', 'CMF_AGENT_CDH_ZOOKEEPER_HOME'**: '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_**HOME': '/usr/lib/hadoop',
    'CMF_AGENT_JSVC_HOME': '/usr/libexec/bigtop-utils',
    'CMF_AGENT_CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CMF_AGENT_CDH_MR1_HOME': '/usr/lib/hadoop-0.20-**mapreduce',
    'CMF_AGENT_CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'PWD': '/',
    'CMF_AGENT_CDH_HADOOP_HOME': '/usr/lib/hadoop',
    'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Supervised
    processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_**JAR':
    '/usr/share/java/oracle-**connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-**default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR'**: '/usr/share/cmf/lib/**postgresql-9.0-801.jdbc4.jar',
    'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME':
    '/usr/share/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR'**:
    '/usr/share/java/mysql-**connector-java.jar', 'CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-**mapreduce', 'CDH_PIG_HOME': '/usr/lib/pig',
    'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat',
    'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent/**process
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent/**supervisor
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent/**supervisor/include
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Failed to
    connect to previous supervisor.
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread agent INFO Trying to
    connect to newly launched supervisor (Attempt 1)
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread agent INFO Successfully
    connected to supervisor
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
    [08/Aug/2013:09:03:08] ENGINE Bus STARTING
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
    [08/Aug/2013:09:03:08] ENGINE Started monitor thread '_TimeoutMonitor'.
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
    [08/Aug/2013:09:03:08] ENGINE Serving on cshdp15:9000
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
    [08/Aug/2013:09:03:08] ENGINE Bus STARTED
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread __init__ INFO New monitor:
    (<cmf.monitor.host.hostmonitor object@0x2575910>,)
    [08/Aug/2013 09:03:08 +0000] 9661 MonitorDaemon-Scheduler __init__ INFO
    Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x2575910>,)
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread agent WARNING Setting
    default socket timeout to 30!
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO No cgrouped
    processes running; unmounting any cgroup roots
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO No processes are
    being managed; Supervisor will shutdown.
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Shutting down
    supervisord, pid 9468
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Successfully
    shutdown supervisord, pid 9468
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus STOPPING
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE HTTP Server cherrypy._cpwsgi_server.**CPWSGIServer(('cshdp15',
    9000)) shut down
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Stopped thread '_TimeoutMonitor'.
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus STOPPED
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus STOPPING
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE HTTP Server cherrypy._cpwsgi_server.**CPWSGIServer(('cshdp15',
    9000)) already shut down
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE No thread running for None.
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus STOPPED
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus EXITING
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread _cplogging INFO
    [08/Aug/2013:09:03:03] ENGINE Bus EXITED
    [08/Aug/2013 09:03:03 +0000] 9448 MainThread agent INFO Agent exiting;
    caught signal 15
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO No command line
    vars
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Agent starting
    as pid 9661 user root(0) group root(0).
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread downloader INFO Downloader
    path: /opt/cloudera/parcel-cache
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent/**cgroups
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
    /var/run/cloudera-scm-agent/**cgroups/memory
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
    /var/run/cloudera-scm-agent/**cgroups/cpu
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread cgroups INFO Reusing
    /var/run/cloudera-scm-agent/**cgroups/blkio
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Found cgroups
    capabilities: {'has_memory': True, 'default_memory_limit_in_**bytes':
    9223372036854775807, 'writable_cgroup_dot_procs': True, 'has_cpu': True,
    'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_blkio':
    True}
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Setting up
    supervisord event monitor.
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
    timeout of 2.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
    join timeout of 0.100000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread filesystem_map INFO Using
    tolerance of 60.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread metrics INFO Importing
    tasktracker metric schema from file /usr/lib64/cmf/agent/src/cmf/**
    monitor/tasktracker/schema.**json
    [08/Aug/2013 09:03:05 +0000] 9661 MainThread __init__ INFO Importing
    metric schema from file /usr/lib64/cmf/agent/src/cmf/**monitor/schema.json
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Supervised
    processes will inherit the following environment: {'CMF_CONF_DIR':
    '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-**default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH': '/sbin:/usr/sbin:/bin:/usr/**bin', 'CMF_AGENT_CDH_FLUME_HOME':
    '/usr/lib/flume-ng', 'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG':
    'en_US.UTF-8', 'TERM': 'vt100', 'CLOUDERA_ORACLE_CONNECTOR_**JAR':
    '/usr/share/java/oracle-**connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR'**:
    '/usr/share/cmf/lib/**postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR'**: '/usr/share/java/mysql-
    **connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME': '/usr/lib/hadoop-yarn',
    'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop', 'CMF_AGENT_CDH_OOZIE_HOME':
    '/usr/lib/oozie', 'CMF_AGENT_CDH_ZOOKEEPER_HOME'**: '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_**HOME': '/usr/lib/hadoop',
    'CMF_AGENT_JSVC_HOME': '/usr/libexec/bigtop-utils',
    'CMF_AGENT_CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CMF_AGENT_CDH_MR1_HOME': '/usr/lib/hadoop-0.20-**mapreduce',
    'CMF_AGENT_CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'PWD': '/',
    'CMF_AGENT_CDH_HADOOP_HOME': '/usr/lib/hadoop',
    'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Supervised
    processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_**JAR':
    '/usr/share/java/oracle-**connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-**default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR'**: '/usr/share/cmf/lib/**postgresql-9.0-801.jdbc4.jar',
    'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME':
    '/usr/share/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR'**:
    '/usr/share/java/mysql-**connector-java.jar', 'CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-**mapreduce', 'CDH_PIG_HOME': '/usr/lib/pig',
    'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat',
    'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent/**process
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent/**supervisor
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Re-using
    pre-existing directory: /var/run/cloudera-scm-agent/**supervisor/include
    [08/Aug/2013 09:03:07 +0000] 9661 MainThread agent INFO Failed to
    connect to previous supervisor.
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread agent INFO Trying to
    connect to newly launched supervisor (Attempt 1)
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread agent INFO Successfully
    connected to supervisor
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
    [08/Aug/2013:09:03:08] ENGINE Bus STARTING
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
    [08/Aug/2013:09:03:08] ENGINE Started monitor thread '_TimeoutMonitor'.
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
    [08/Aug/2013:09:03:08] ENGINE Serving on cshdp15:9000
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread _cplogging INFO
    [08/Aug/2013:09:03:08] ENGINE Bus STARTED
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread __init__ INFO New monitor:
    (<cmf.monitor.host.hostmonitor object@0x2575910>,)
    [08/Aug/2013 09:03:08 +0000] 9661 MonitorDaemon-Scheduler __init__ INFO
    Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x2575910>,)
    [08/Aug/2013 09:03:08 +0000] 9661 MainThread agent WARNING Setting
    default socket timeout to 30!
    END (0)
    end of agent logs.
    scm agent restarted
    Installation script completed successfully.
    all done
    closing logging file descriptor







    1 2 3 4 5 6 7

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedAug 8, '13 at 5:59p
activeAug 8, '13 at 6:53p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Mani: 1 post Herman Chen: 1 post

People

Translate

site design / logo © 2022 Grokbase