Hi,
I'm having some troubles installing a host. My etc/hosts looks like this:
127.0.0.1 localhost
127.0.1.1 jonathan-K70IC
192.168.178.22 masterserver
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
As suggested in some other threads I chose my local IP address namely
masterserver as host. When I run the installation it returns "Installation
failed. Failed to receive heartbeat from agent.".
This is what is logged into
var/log/cloudera-scm-agent/cloudera-scm-agent,log everytime I try to to
install the host:
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
Stopping agent...
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO No
cgrouped processes running; unmounting any cgroup roots
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO No
processes are being managed; Supervisor will shutdown.
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
Shutting down supervisord, pid 10052
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
Successfully shutdown supervisord, pid 10052
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus STOPPING
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('jonathan-K70IC', 9000)) shut down
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Stopped thread '_TimeoutMonitor'.
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus STOPPED
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus STOPPING
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('jonathan-K70IC', 9000)) already shut
down
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE No thread running for None.
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus STOPPED
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus EXITING
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus EXITED
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO Agent
exiting; caught signal 15
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO No
command line vars
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Agent
starting as pid 10736 user root(0) group root(0).
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent
[03/Apr/2013 02:10:58 +0000] 10736 MainThread downloader INFO
Downloader path: /opt/cloudera/parcel-cache
[03/Apr/2013 02:10:58 +0000] 10736 MainThread parcel_cache INFO Using
/opt/cloudera/parcel-cache for parcel cache
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
[03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO Reusing
/run/cloudera-scm-agent/cgroups/memory
[03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO Reusing
/run/cloudera-scm-agent/cgroups/cpu
[03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO Reusing
/run/cloudera-scm-agent/cgroups/blkio
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Found
cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes':
9223372036854775807, 'writable_cgroup_dot_procs': True, 'has_cpu': True,
'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_blkio': True}
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Setting
up eager heartbeat event monitor.
[03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO Using
timeout of 2.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO Using
join timeout of 0.100000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO Using
tolerance of 60.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
metrics_url_timeout_seconds of 30.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
task_metrics_timeout_seconds of 5.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
max_collection_wait_seconds of 10.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread metrics INFO
Importing tasktracker metric schema from file
/usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
[03/Apr/2013 02:10:58 +0000] 10736 MainThread __init__ INFO
Importing metric schema from file
/usr/lib/cmf/agent/src/cmf/monitor/schema.json
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Supervised processes will inherit the following environment:
{'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
'/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
'/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'PATH':
'/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': 'en_US.UTF-8',
'TERM': 'vt100', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
'/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
'/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
'/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
'/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
'/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
'/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
'/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
'/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Supervised processes will add the following their environment environment:
{'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
'/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
'/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
'/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
'/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
'/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
'/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent/process
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO Failed
to connect to previous supervisor.
[03/Apr/2013 02:11:00 +0000] 10736 MainThread agent INFO Trying
to connect to newly launched supervisor (Attempt 1)
[03/Apr/2013 02:11:00 +0000] 10736 MainThread agent INFO
Successfully connected to supervisor
[03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
[03/Apr/2013:02:11:00] ENGINE Bus STARTING
[03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
[03/Apr/2013:02:11:00] ENGINE Started monitor thread '_TimeoutMonitor'.
[03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
[03/Apr/2013:02:11:00] ENGINE Serving on jonathan-K70IC:9000
[03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
[03/Apr/2013:02:11:00] ENGINE Bus STARTED
[03/Apr/2013 02:11:00 +0000] 10736 MainThread __init__ INFO New
monitor: (<cmf.monitor.host.hostmonitor object@0x20ffe50>,)
[03/Apr/2013 02:11:00 +0000] 10736 MainThread agent WARNING Setting
default socket timeout to 30!
[03/Apr/2013 02:11:00 +0000] 10736 MonitorDaemon-Scheduler __init__
INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
0x20ffe50>,)
Thanks in advance,
Jonathan