FAQ
I am trying to do cluster installation on Ubuntu 12.04 virtual private
machines using Cloudera Manager free edition but getting "Failed to receive
heartbeat from agent"
message.

Please help.

Here's the log from /var/log/cloudera-scm-agent:

[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO No
command line vars
[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Agent
starting as pid 6349 user root(0) group root(0).
[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent
[31/May/2013 03:04:33 +0000] 6349 MainThread downloader INFO
Downloader path: /opt/cloudera/parcel-cache
[31/May/2013 03:04:33 +0000] 6349 MainThread parcel_cache INFO Using
/opt/cloudera/parcel-cache for parcel cache
[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent/cgroups
[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Found
cgroups capabilities: {'has_memory': False,
'default_memory_limit_in_bytes': -1, 'writable_cgroup_dot_procs': False,
'has_cpu': False, 'default_blkio_weight': -1, 'default_cpu_shares': -1,
'has_blkio': False}
[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Setting
up supervisord event monitor.
[31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO Using
timeout of 2.000000
[31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO Using
join timeout of 0.100000
[31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO Using
tolerance of 60.000000
[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
metrics_url_timeout_seconds of 30.000000
[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
task_metrics_timeout_seconds of 5.000000
[31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
max_collection_wait_seconds of 10.000000
[31/May/2013 03:04:33 +0000] 6349 MainThread metrics INFO
Importing tasktracker metric schema from file
/usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
[31/May/2013 03:04:33 +0000] 6349 MainThread abstract_monitor ERROR
  Could not create directory monitor for /var/log/cloudera-scm-agent
Traceback (most recent call last):
   File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line 295,
in create_dir_monitor
     directory))
   File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
__init__
     raise Exception("Could not find local file system for %s" %
(self._path,))
Exception: Could not find local file system for /var/log/cloudera-scm-agent
[31/May/2013 03:04:34 +0000] 6349 MainThread __init__ INFO
Importing metric schema from file
/usr/lib/cmf/agent/src/cmf/monitor/schema.json
[31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
Supervised processes will inherit the following environment:
{'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
'/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
'/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'PATH':
'/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': '', 'TERM': 'vt100',
'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
'/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
'/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
'/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
'/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
'/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
'/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
'/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
'/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
[31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
Supervised processes will add the following their environment environment:
{'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
'/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
'/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
'/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
'/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
'/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
'/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent/process
[31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent/supervisor
[31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent/supervisor/include
[31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO Failed
to connect to previous supervisor.
[31/May/2013 03:04:35 +0000] 6349 MainThread agent INFO Trying
to connect to newly launched supervisor (Attempt 1)
[31/May/2013 03:04:35 +0000] 6349 MainThread agent INFO
Successfully connected to supervisor
[31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:03:04:35] ENGINE Bus STARTING
[31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:03:04:35] ENGINE Started monitor thread '_TimeoutMonitor'.
[31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:03:04:35] ENGINE Serving on vm2826.fortatrust.com:9000
[31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:03:04:35] ENGINE Bus STARTED
[31/May/2013 03:04:35 +0000] 6349 MainThread __init__ INFO New
monitor: (<cmf.monitor.host.hostmonitor object@0x2660250>,)
[31/May/2013 03:04:35 +0000] 6349 MainThread agent WARNING Setting
default socket timeout to 30!
[31/May/2013 03:04:35 +0000] 6349 MonitorDaemon-Scheduler __init__ INFO
     Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
0x2660250>,)
[31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO Stopping
agent...
[31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO No
cgrouped processes running; unmounting any cgroup roots
[31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO No
processes are being managed; Supervisor will shutdown.
[31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO Shutting
down supervisord, pid 6364
[31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
Successfully shutdown supervisord, pid 6364
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE Bus STOPPING
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('vm2826.fortatrust.com', 9000)) shut
down
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE Stopped thread '_TimeoutMonitor'.
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE Bus STOPPED
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE Bus STOPPING
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('vm2826.fortatrust.com', 9000))
already shut down
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE No thread running for None.
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE Bus STOPPED
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE Bus EXITING
[31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
[31/May/2013:06:40:39] ENGINE Bus EXITED
[31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO Agent
exiting; caught signal 15
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO No
command line vars
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Agent
starting as pid 9654 user root(0) group root(0).
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent
[31/May/2013 06:40:40 +0000] 9654 MainThread downloader INFO
Downloader path: /opt/cloudera/parcel-cache
[31/May/2013 06:40:40 +0000] 9654 MainThread parcel_cache INFO Using
/opt/cloudera/parcel-cache for parcel cache
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent/cgroups
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Found
cgroups capabilities: {'has_memory': False,
'default_memory_limit_in_bytes': -1, 'writable_cgroup_dot_procs': False,
'has_cpu': False, 'default_blkio_weight': -1, 'default_cpu_shares': -1,
'has_blkio': False}
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Setting
up supervisord event monitor.
[31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO Using
timeout of 2.000000
[31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO Using
join timeout of 0.100000
[31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO Using
tolerance of 60.000000
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
metrics_url_timeout_seconds of 30.000000
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
task_metrics_timeout_seconds of 5.000000
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
max_collection_wait_seconds of 10.000000
[31/May/2013 06:40:40 +0000] 9654 MainThread metrics INFO
Importing tasktracker metric schema from file
/usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
[31/May/2013 06:40:40 +0000] 9654 MainThread abstract_monitor ERROR
  Could not create directory monitor for /var/log/cloudera-scm-agent
Traceback (most recent call last):
   File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line 295,
in create_dir_monitor
     directory))
   File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
__init__
     raise Exception("Could not find local file system for %s" %
(self._path,))
Exception: Could not find local file system for /var/log/cloudera-scm-agent
[31/May/2013 06:40:40 +0000] 9654 MainThread __init__ INFO
Importing metric schema from file
/usr/lib/cmf/agent/src/cmf/monitor/schema.json
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
Supervised processes will inherit the following environment:
{'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
'/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
'/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'PATH':
'/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': '', 'TERM': 'vt100',
'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
'/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
'/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
'/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
'/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
'/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
'/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
'/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
'/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
Supervised processes will add the following their environment environment:
{'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
'/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
'/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
'/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
'/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
'/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
'/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent/process
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent/supervisor
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Re-using
pre-existing directory: /run/cloudera-scm-agent/supervisor/include
[31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Failed
to connect to previous supervisor.
[31/May/2013 06:40:41 +0000] 9654 MainThread agent INFO Trying
to connect to newly launched supervisor (Attempt 1)
[31/May/2013 06:40:41 +0000] 9654 MainThread agent INFO
Successfully connected to supervisor
[31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
[31/May/2013:06:40:41] ENGINE Bus STARTING
[31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
[31/May/2013:06:40:41] ENGINE Started monitor thread '_TimeoutMonitor'.
[31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
[31/May/2013:06:40:41] ENGINE Serving on vm2826.fortatrust.com:9000
[31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
[31/May/2013:06:40:41] ENGINE Bus STARTED
[31/May/2013 06:40:41 +0000] 9654 MainThread __init__ INFO New
monitor: (<cmf.monitor.host.hostmonitor object@0x1d15250>,)
[31/May/2013 06:40:41 +0000] 9654 MainThread agent WARNING Setting
default socket timeout to 30!
[31/May/2013 06:40:41 +0000] 9654 MonitorDaemon-Scheduler __init__ INFO
     Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
0x1d15250>,)

Search Discussions

  • Jean-Marc Spaggiari at May 31, 2013 at 3:14 am
    Hi,

    Have you configured your nodes on the hosts files? Can you share your
    /etc/hosts file?

    Thanks,

    JMS
    Le 2013-05-30 19:51, "Rohit Chauhan" <rohithome@gmail.com> a écrit :
    I am trying to do cluster installation on Ubuntu 12.04 virtual private
    machines using Cloudera Manager free edition but getting "Failed to receive
    heartbeat from agent"
    message.

    Please help.

    Here's the log from /var/log/cloudera-scm-agent:

    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO No
    command line vars
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Agent
    starting as pid 6349 user root(0) group root(0).
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent
    [31/May/2013 03:04:33 +0000] 6349 MainThread downloader INFO
    Downloader path: /opt/cloudera/parcel-cache
    [31/May/2013 03:04:33 +0000] 6349 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Found
    cgroups capabilities: {'has_memory': False,
    'default_memory_limit_in_bytes': -1, 'writable_cgroup_dot_procs': False,
    'has_cpu': False, 'default_blkio_weight': -1, 'default_cpu_shares': -1,
    'has_blkio': False}
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Setting
    up supervisord event monitor.
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO Using
    timeout of 2.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO Using
    join timeout of 0.100000
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO Using
    tolerance of 60.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread metrics INFO
    Importing tasktracker metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
    [31/May/2013 03:04:33 +0000] 6349 MainThread abstract_monitor ERROR
    Could not create directory monitor for /var/log/cloudera-scm-agent
    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line 295,
    in create_dir_monitor
    directory))
    File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
    __init__
    raise Exception("Could not find local file system for %s" %
    (self._path,))
    Exception: Could not find local file system for /var/log/cloudera-scm-agent
    [31/May/2013 03:04:34 +0000] 6349 MainThread __init__ INFO
    Importing metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/schema.json
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Supervised processes will inherit the following environment:
    {'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH':
    '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
    'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
    'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': '', 'TERM': 'vt100',
    'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
    '/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
    'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
    '/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
    '/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
    '/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Supervised processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
    '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
    '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
    'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
    'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
    '/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/process
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO Failed
    to connect to previous supervisor.
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent INFO Trying
    to connect to newly launched supervisor (Attempt 1)
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent INFO
    Successfully connected to supervisor
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Bus STARTING
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Started monitor thread '_TimeoutMonitor'.
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Serving on vm2826.fortatrust.com:9000
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Bus STARTED
    [31/May/2013 03:04:35 +0000] 6349 MainThread __init__ INFO New
    monitor: (<cmf.monitor.host.hostmonitor object@0x2660250>,)
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent WARNING Setting
    default socket timeout to 30!
    [31/May/2013 03:04:35 +0000] 6349 MonitorDaemon-Scheduler __init__
    INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x2660250>,)
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Stopping agent...
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO No
    cgrouped processes running; unmounting any cgroup roots
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO No
    processes are being managed; Supervisor will shutdown.
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Shutting down supervisord, pid 6364
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Successfully shutdown supervisord, pid 6364
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('vm2826.fortatrust.com', 9000))
    shut down
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Stopped thread '_TimeoutMonitor'.
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPED
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('vm2826.fortatrust.com', 9000))
    already shut down
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE No thread running for None.
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPED
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus EXITING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus EXITED
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO Agent
    exiting; caught signal 15
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO No
    command line vars
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Agent
    starting as pid 9654 user root(0) group root(0).
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent
    [31/May/2013 06:40:40 +0000] 9654 MainThread downloader INFO
    Downloader path: /opt/cloudera/parcel-cache
    [31/May/2013 06:40:40 +0000] 9654 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Found
    cgroups capabilities: {'has_memory': False,
    'default_memory_limit_in_bytes': -1, 'writable_cgroup_dot_procs': False,
    'has_cpu': False, 'default_blkio_weight': -1, 'default_cpu_shares': -1,
    'has_blkio': False}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Setting
    up supervisord event monitor.
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO Using
    timeout of 2.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO Using
    join timeout of 0.100000
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO Using
    tolerance of 60.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread metrics INFO
    Importing tasktracker metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
    [31/May/2013 06:40:40 +0000] 9654 MainThread abstract_monitor ERROR
    Could not create directory monitor for /var/log/cloudera-scm-agent
    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line 295,
    in create_dir_monitor
    directory))
    File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
    __init__
    raise Exception("Could not find local file system for %s" %
    (self._path,))
    Exception: Could not find local file system for /var/log/cloudera-scm-agent
    [31/May/2013 06:40:40 +0000] 9654 MainThread __init__ INFO
    Importing metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/schema.json
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Supervised processes will inherit the following environment:
    {'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH':
    '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
    'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
    'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': '', 'TERM': 'vt100',
    'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
    '/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
    'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
    '/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
    '/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
    '/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Supervised processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
    '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
    '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
    'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
    'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
    '/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/process
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Failed
    to connect to previous supervisor.
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent INFO Trying
    to connect to newly launched supervisor (Attempt 1)
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent INFO
    Successfully connected to supervisor
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Bus STARTING
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Started monitor thread '_TimeoutMonitor'.
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Serving on vm2826.fortatrust.com:9000
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Bus STARTED
    [31/May/2013 06:40:41 +0000] 9654 MainThread __init__ INFO New
    monitor: (<cmf.monitor.host.hostmonitor object@0x1d15250>,)
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent WARNING Setting
    default socket timeout to 30!
    [31/May/2013 06:40:41 +0000] 9654 MonitorDaemon-Scheduler __init__
    INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x1d15250>,)
  • Adam Smieszny at Jun 24, 2013 at 9:32 pm
    The error that I see seems to be an issue with permissions on /var/log

    [31/May/2013 06:40:40 +0000] 9654 MainThread abstract_monitor ERROR
      Could not create directory monitor for /var/log/cloudera-scm-agent
    Traceback (most recent call last):
       File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line 295,
    in create_dir_monitor
         directory))
       File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
    __init__
         raise Exception("Could not find local file system for %s" %
    (self._path,))
    Exception: Could not find local file system for /var/log/cloudera-scm-agent


    The agent actually appears to have started, but likely won't be able to log
    anything. Can you confirm the permissions on that dir?

    On Thu, May 30, 2013 at 11:14 PM, Jean-Marc Spaggiari wrote:

    Hi,

    Have you configured your nodes on the hosts files? Can you share your
    /etc/hosts file?

    Thanks,

    JMS
    Le 2013-05-30 19:51, "Rohit Chauhan" <rohithome@gmail.com> a écrit :

    I am trying to do cluster installation on Ubuntu 12.04 virtual private
    machines using Cloudera Manager free edition but getting "Failed to receive
    heartbeat from agent"
    message.

    Please help.

    Here's the log from /var/log/cloudera-scm-agent:

    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO No
    command line vars
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Agent
    starting as pid 6349 user root(0) group root(0).
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent
    [31/May/2013 03:04:33 +0000] 6349 MainThread downloader INFO
    Downloader path: /opt/cloudera/parcel-cache
    [31/May/2013 03:04:33 +0000] 6349 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Found
    cgroups capabilities: {'has_memory': False,
    'default_memory_limit_in_bytes': -1, 'writable_cgroup_dot_procs': False,
    'has_cpu': False, 'default_blkio_weight': -1, 'default_cpu_shares': -1,
    'has_blkio': False}
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO
    Setting up supervisord event monitor.
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Using timeout of 2.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Using join timeout of 0.100000
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Using tolerance of 60.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread metrics INFO
    Importing tasktracker metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
    [31/May/2013 03:04:33 +0000] 6349 MainThread abstract_monitor ERROR
    Could not create directory monitor for /var/log/cloudera-scm-agent
    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line
    295, in create_dir_monitor
    directory))
    File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
    __init__
    raise Exception("Could not find local file system for %s" %
    (self._path,))
    Exception: Could not find local file system for
    /var/log/cloudera-scm-agent
    [31/May/2013 03:04:34 +0000] 6349 MainThread __init__ INFO
    Importing metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/schema.json
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Supervised processes will inherit the following environment:
    {'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH':
    '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
    'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
    'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': '', 'TERM': 'vt100',
    'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
    '/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
    'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
    '/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
    '/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
    '/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Supervised processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
    '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
    '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
    'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
    'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
    '/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/process
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO Failed
    to connect to previous supervisor.
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent INFO Trying
    to connect to newly launched supervisor (Attempt 1)
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent INFO
    Successfully connected to supervisor
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Bus STARTING
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Started monitor thread '_TimeoutMonitor'.
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Serving on vm2826.fortatrust.com:9000
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Bus STARTED
    [31/May/2013 03:04:35 +0000] 6349 MainThread __init__ INFO New
    monitor: (<cmf.monitor.host.hostmonitor object@0x2660250>,)
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent WARNING
    Setting default socket timeout to 30!
    [31/May/2013 03:04:35 +0000] 6349 MonitorDaemon-Scheduler __init__
    INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x2660250>,)
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Stopping agent...
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO No
    cgrouped processes running; unmounting any cgroup roots
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO No
    processes are being managed; Supervisor will shutdown.
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Shutting down supervisord, pid 6364
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Successfully shutdown supervisord, pid 6364
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('vm2826.fortatrust.com', 9000))
    shut down
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Stopped thread '_TimeoutMonitor'.
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPED
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('vm2826.fortatrust.com', 9000))
    already shut down
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE No thread running for None.
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPED
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus EXITING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus EXITED
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO Agent
    exiting; caught signal 15
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO No
    command line vars
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Agent
    starting as pid 9654 user root(0) group root(0).
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent
    [31/May/2013 06:40:40 +0000] 9654 MainThread downloader INFO
    Downloader path: /opt/cloudera/parcel-cache
    [31/May/2013 06:40:40 +0000] 9654 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Found
    cgroups capabilities: {'has_memory': False,
    'default_memory_limit_in_bytes': -1, 'writable_cgroup_dot_procs': False,
    'has_cpu': False, 'default_blkio_weight': -1, 'default_cpu_shares': -1,
    'has_blkio': False}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Setting up supervisord event monitor.
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Using timeout of 2.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Using join timeout of 0.100000
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Using tolerance of 60.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread metrics INFO
    Importing tasktracker metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
    [31/May/2013 06:40:40 +0000] 9654 MainThread abstract_monitor ERROR
    Could not create directory monitor for /var/log/cloudera-scm-agent
    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line
    295, in create_dir_monitor
    directory))
    File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
    __init__
    raise Exception("Could not find local file system for %s" %
    (self._path,))
    Exception: Could not find local file system for
    /var/log/cloudera-scm-agent
    [31/May/2013 06:40:40 +0000] 9654 MainThread __init__ INFO
    Importing metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/schema.json
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Supervised processes will inherit the following environment:
    {'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH':
    '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
    'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
    'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': '', 'TERM': 'vt100',
    'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
    '/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
    'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
    '/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
    '/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
    '/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Supervised processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
    '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
    '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
    'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
    'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
    '/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/process
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Failed
    to connect to previous supervisor.
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent INFO Trying
    to connect to newly launched supervisor (Attempt 1)
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent INFO
    Successfully connected to supervisor
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Bus STARTING
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Started monitor thread '_TimeoutMonitor'.
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Serving on vm2826.fortatrust.com:9000
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Bus STARTED
    [31/May/2013 06:40:41 +0000] 9654 MainThread __init__ INFO New
    monitor: (<cmf.monitor.host.hostmonitor object@0x1d15250>,)
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent WARNING
    Setting default socket timeout to 30!
    [31/May/2013 06:40:41 +0000] 9654 MonitorDaemon-Scheduler __init__
    INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x1d15250>,)

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156
  • J at Nov 27, 2013 at 4:34 am
    Is this solved? Currently I'm having the exactly same problem when
    installing cdh4.5.0 with cm4.8.0.1.

    I followed the code and saw FilesystemMap.get_filesystem_by_path
    (/usr/lib64/cmf/agent/src/cmf/monitor/host/filesystem_map.py) returned
    None because _fs_map has only /data1 and /dev/shm (input paths
    are /var/run/cloudera-scm-agent and /opt/cloudera/parcels).

    Being solved, let me know how to do please.

    Thanks.

    ps. I checked these;
    /usr/lib64/cmf/agent/src/cmf/monitor/dir_monitor.py
    /usr/lib64/cmf/agent/src/cmf/monitor/abstract_monitor.py
    /usr/lib64/cmf/agent/src/cmf/monitor/host/filesystem_map.py

    2013년 6월 25일 화요일 오전 6시 32분 29초 UTC+9, Adam Smieszny 님의 말:
    The error that I see seems to be an issue with permissions on /var/log

    [31/May/2013 06:40:40 +0000] 9654 MainThread abstract_monitor ERROR
    Could not create directory monitor for /var/log/cloudera-scm-agent
    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line 295,
    in create_dir_monitor
    directory))
    File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
    __init__
    raise Exception("Could not find local file system for %s" %
    (self._path,))
    Exception: Could not find local file system for /var/log/cloudera-scm-agent


    The agent actually appears to have started, but likely won't be able to
    log anything. Can you confirm the permissions on that dir?


    On Thu, May 30, 2013 at 11:14 PM, Jean-Marc Spaggiari <j...@cloudera.com<javascript:>
    wrote:
    Hi,

    Have you configured your nodes on the hosts files? Can you share your
    /etc/hosts file?

    Thanks,

    JMS
    Le 2013-05-30 19:51, "Rohit Chauhan" <rohi...@gmail.com <javascript:>> a
    écrit :

    I am trying to do cluster installation on Ubuntu 12.04 virtual private
    machines using Cloudera Manager free edition but getting "Failed to receive
    heartbeat from agent"
    message.

    Please help.

    Here's the log from /var/log/cloudera-scm-agent:

    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO No
    command line vars
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Agent
    starting as pid 6349 user root(0) group root(0).
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent
    [31/May/2013 03:04:33 +0000] 6349 MainThread downloader INFO
    Downloader path: /opt/cloudera/parcel-cache
    [31/May/2013 03:04:33 +0000] 6349 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Found
    cgroups capabilities: {'has_memory': False,
    'default_memory_limit_in_bytes': -1, 'writable_cgroup_dot_procs': False,
    'has_cpu': False, 'default_blkio_weight': -1, 'default_cpu_shares': -1,
    'has_blkio': False}
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO
    Setting up supervisord event monitor.
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Using timeout of 2.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Using join timeout of 0.100000
    [31/May/2013 03:04:33 +0000] 6349 MainThread filesystem_map INFO
    Using tolerance of 60.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [31/May/2013 03:04:33 +0000] 6349 MainThread metrics INFO
    Importing tasktracker metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
    [31/May/2013 03:04:33 +0000] 6349 MainThread abstract_monitor ERROR
    Could not create directory monitor for /var/log/cloudera-scm-agent
    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line
    295, in create_dir_monitor
    directory))
    File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
    __init__
    raise Exception("Could not find local file system for %s" %
    (self._path,))
    Exception: Could not find local file system for
    /var/log/cloudera-scm-agent
    [31/May/2013 03:04:34 +0000] 6349 MainThread __init__ INFO
    Importing metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/schema.json
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Supervised processes will inherit the following environment:
    {'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH':
    '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
    'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
    'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': '', 'TERM': 'vt100',
    'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
    '/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
    'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
    '/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
    '/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
    '/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Supervised processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
    '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
    '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
    'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
    'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
    '/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/process
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
    [31/May/2013 03:04:34 +0000] 6349 MainThread agent INFO
    Failed to connect to previous supervisor.
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent INFO
    Trying to connect to newly launched supervisor (Attempt 1)
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent INFO
    Successfully connected to supervisor
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Bus STARTING
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Started monitor thread '_TimeoutMonitor'.
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Serving on vm2826.fortatrust.com:9000
    [31/May/2013 03:04:35 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:03:04:35] ENGINE Bus STARTED
    [31/May/2013 03:04:35 +0000] 6349 MainThread __init__ INFO New
    monitor: (<cmf.monitor.host.hostmonitor object@0x2660250>,)
    [31/May/2013 03:04:35 +0000] 6349 MainThread agent WARNING
    Setting default socket timeout to 30!
    [31/May/2013 03:04:35 +0000] 6349 MonitorDaemon-Scheduler __init__
    INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x2660250>,)
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Stopping agent...
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO No
    cgrouped processes running; unmounting any cgroup roots
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO No
    processes are being managed; Supervisor will shutdown.
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Shutting down supervisord, pid 6364
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO
    Successfully shutdown supervisord, pid 6364
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('vm2826.fortatrust.com', 9000))
    shut down
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Stopped thread '_TimeoutMonitor'.
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPED
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('vm2826.fortatrust.com', 9000))
    already shut down
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE No thread running for None.
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus STOPPED
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus EXITING
    [31/May/2013 06:40:39 +0000] 6349 MainThread _cplogging INFO
    [31/May/2013:06:40:39] ENGINE Bus EXITED
    [31/May/2013 06:40:39 +0000] 6349 MainThread agent INFO Agent
    exiting; caught signal 15
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO No
    command line vars
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Agent
    starting as pid 9654 user root(0) group root(0).
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent
    [31/May/2013 06:40:40 +0000] 9654 MainThread downloader INFO
    Downloader path: /opt/cloudera/parcel-cache
    [31/May/2013 06:40:40 +0000] 9654 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Found
    cgroups capabilities: {'has_memory': False,
    'default_memory_limit_in_bytes': -1, 'writable_cgroup_dot_procs': False,
    'has_cpu': False, 'default_blkio_weight': -1, 'default_cpu_shares': -1,
    'has_blkio': False}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Setting up supervisord event monitor.
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Using timeout of 2.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Using join timeout of 0.100000
    [31/May/2013 06:40:40 +0000] 9654 MainThread filesystem_map INFO
    Using tolerance of 60.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [31/May/2013 06:40:40 +0000] 9654 MainThread metrics INFO
    Importing tasktracker metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
    [31/May/2013 06:40:40 +0000] 9654 MainThread abstract_monitor ERROR
    Could not create directory monitor for /var/log/cloudera-scm-agent
    Traceback (most recent call last):
    File "/usr/lib/cmf/agent/src/cmf/monitor/abstract_monitor.py", line
    295, in create_dir_monitor
    directory))
    File "/usr/lib/cmf/agent/src/cmf/monitor/dir_monitor.py", line 17, in
    __init__
    raise Exception("Could not find local file system for %s" %
    (self._path,))
    Exception: Could not find local file system for
    /var/log/cloudera-scm-agent
    [31/May/2013 06:40:40 +0000] 9654 MainThread __init__ INFO
    Importing metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/schema.json
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Supervised processes will inherit the following environment:
    {'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH':
    '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
    'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
    'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': '', 'TERM': 'vt100',
    'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
    '/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
    'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
    '/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
    '/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
    '/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Supervised processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
    '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
    '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
    'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
    'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
    '/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/process
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
    [31/May/2013 06:40:40 +0000] 9654 MainThread agent INFO
    Failed to connect to previous supervisor.
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent INFO
    Trying to connect to newly launched supervisor (Attempt 1)
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent INFO
    Successfully connected to supervisor
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Bus STARTING
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Started monitor thread '_TimeoutMonitor'.
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Serving on vm2826.fortatrust.com:9000
    [31/May/2013 06:40:41 +0000] 9654 MainThread _cplogging INFO
    [31/May/2013:06:40:41] ENGINE Bus STARTED
    [31/May/2013 06:40:41 +0000] 9654 MainThread __init__ INFO New
    monitor: (<cmf.monitor.host.hostmonitor object@0x1d15250>,)
    [31/May/2013 06:40:41 +0000] 9654 MainThread agent WARNING
    Setting default socket timeout to 30!
    [31/May/2013 06:40:41 +0000] 9654 MonitorDaemon-Scheduler __init__
    INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x1d15250>,)

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedMay 31, '13 at 2:51a
activeNov 27, '13 at 4:34a
posts4
users4
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase