FAQ
Hi,
I'm having some troubles installing a host. My etc/hosts looks like this:

127.0.0.1 localhost
127.0.1.1 jonathan-K70IC
192.168.178.22 masterserver

# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters

As suggested in some other threads I chose my local IP address namely
masterserver as host. When I run the installation it returns "Installation
failed. Failed to receive heartbeat from agent.".
This is what is logged into
var/log/cloudera-scm-agent/cloudera-scm-agent,log everytime I try to to
install the host:

[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
Stopping agent...
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO No
cgrouped processes running; unmounting any cgroup roots
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO No
processes are being managed; Supervisor will shutdown.
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
Shutting down supervisord, pid 10052
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
Successfully shutdown supervisord, pid 10052
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus STOPPING
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('jonathan-K70IC', 9000)) shut down
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Stopped thread '_TimeoutMonitor'.
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus STOPPED
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus STOPPING
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE HTTP Server
cherrypy._cpwsgi_server.CPWSGIServer(('jonathan-K70IC', 9000)) already shut
down
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE No thread running for None.
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus STOPPED
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus EXITING
[03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
[03/Apr/2013:02:10:57] ENGINE Bus EXITED
[03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO Agent
exiting; caught signal 15
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO No
command line vars
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Agent
starting as pid 10736 user root(0) group root(0).
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent
[03/Apr/2013 02:10:58 +0000] 10736 MainThread downloader INFO
Downloader path: /opt/cloudera/parcel-cache
[03/Apr/2013 02:10:58 +0000] 10736 MainThread parcel_cache INFO Using
/opt/cloudera/parcel-cache for parcel cache
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
[03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO Reusing
/run/cloudera-scm-agent/cgroups/memory
[03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO Reusing
/run/cloudera-scm-agent/cgroups/cpu
[03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO Reusing
/run/cloudera-scm-agent/cgroups/blkio
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Found
cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes':
9223372036854775807, 'writable_cgroup_dot_procs': True, 'has_cpu': True,
'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_blkio': True}
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Setting
up eager heartbeat event monitor.
[03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO Using
timeout of 2.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO Using
join timeout of 0.100000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO Using
tolerance of 60.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
metrics_url_timeout_seconds of 30.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
task_metrics_timeout_seconds of 5.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
max_collection_wait_seconds of 10.000000
[03/Apr/2013 02:10:58 +0000] 10736 MainThread metrics INFO
Importing tasktracker metric schema from file
/usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
[03/Apr/2013 02:10:58 +0000] 10736 MainThread __init__ INFO
Importing metric schema from file
/usr/lib/cmf/agent/src/cmf/monitor/schema.json
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Supervised processes will inherit the following environment:
{'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
'/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
'/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'PATH':
'/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': 'en_US.UTF-8',
'TERM': 'vt100', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
'/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
'/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
'/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
'/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
'/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
'/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
'/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
'/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Supervised processes will add the following their environment environment:
{'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
'/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
'/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
'/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
'/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
'/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
'CLOUDERA_POSTGRESQL_JDBC_JAR':
'/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
'/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
'/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
'/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
'/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent/process
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
[03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO Failed
to connect to previous supervisor.
[03/Apr/2013 02:11:00 +0000] 10736 MainThread agent INFO Trying
to connect to newly launched supervisor (Attempt 1)
[03/Apr/2013 02:11:00 +0000] 10736 MainThread agent INFO
Successfully connected to supervisor
[03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
[03/Apr/2013:02:11:00] ENGINE Bus STARTING
[03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
[03/Apr/2013:02:11:00] ENGINE Started monitor thread '_TimeoutMonitor'.
[03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
[03/Apr/2013:02:11:00] ENGINE Serving on jonathan-K70IC:9000
[03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
[03/Apr/2013:02:11:00] ENGINE Bus STARTED
[03/Apr/2013 02:11:00 +0000] 10736 MainThread __init__ INFO New
monitor: (<cmf.monitor.host.hostmonitor object@0x20ffe50>,)
[03/Apr/2013 02:11:00 +0000] 10736 MainThread agent WARNING Setting
default socket timeout to 30!
[03/Apr/2013 02:11:00 +0000] 10736 MonitorDaemon-Scheduler __init__
INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
0x20ffe50>,)


Thanks in advance,
Jonathan

Search Discussions

  • Philip Zeyliger at Apr 3, 2013 at 1:22 am
    Serving on jonathan-K70IC:9000
    Hi Jonathan,

    It looks like your host is identifying itself as 127.0.1.1, which is
    unlikely to work. Can you run the following for us?

    $python -c 'import socket; print socket.getfqdn(),
    socket.gethostbyname(socket.getfqdn())'
    p0427.mtv.cloudera.com 172.29.122.19

    Cheers,

    -- Philip


    On Tue, Apr 2, 2013 at 5:13 PM, wrote:

    Hi,
    I'm having some troubles installing a host. My etc/hosts looks like this:

    127.0.0.1 localhost
    127.0.1.1 jonathan-K70IC
    192.168.178.22 masterserver

    # The following lines are desirable for IPv6 capable hosts
    ::1 ip6-localhost ip6-loopback
    fe00::0 ip6-localnet
    ff00::0 ip6-mcastprefix
    ff02::1 ip6-allnodes
    ff02::2 ip6-allrouters

    As suggested in some other threads I chose my local IP address namely
    masterserver as host. When I run the installation it returns "Installation
    failed. Failed to receive heartbeat from agent.".
    This is what is logged into
    var/log/cloudera-scm-agent/cloudera-scm-agent,log everytime I try to to
    install the host:

    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
    Stopping agent...
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO No
    cgrouped processes running; unmounting any cgroup roots
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO No
    processes are being managed; Supervisor will shutdown.
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
    Shutting down supervisord, pid 10052
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
    Successfully shutdown supervisord, pid 10052
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus STOPPING
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('jonathan-K70IC', 9000)) shut down
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Stopped thread '_TimeoutMonitor'.
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus STOPPED
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus STOPPING
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('jonathan-K70IC', 9000)) already shut
    down
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE No thread running for None.
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus STOPPED
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus EXITING
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus EXITED
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO Agent
    exiting; caught signal 15
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO No
    command line vars
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Agent
    starting as pid 10736 user root(0) group root(0).
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread downloader INFO
    Downloader path: /opt/cloudera/parcel-cache
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO
    Reusing /run/cloudera-scm-agent/cgroups/memory
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO
    Reusing /run/cloudera-scm-agent/cgroups/cpu
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO
    Reusing /run/cloudera-scm-agent/cgroups/blkio
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Found
    cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes':
    9223372036854775807, 'writable_cgroup_dot_procs': True, 'has_cpu': True,
    'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_blkio': True}
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
    Setting up eager heartbeat event monitor.
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
    Using timeout of 2.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
    Using join timeout of 0.100000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
    Using tolerance of 60.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread metrics INFO
    Importing tasktracker metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread __init__ INFO
    Importing metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/schema.json
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Supervised processes will inherit the following environment:
    {'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH':
    '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
    'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
    'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': 'en_US.UTF-8',
    'TERM': 'vt100', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
    '/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
    'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
    '/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
    '/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
    '/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Supervised processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
    '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
    '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
    'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
    'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
    '/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/process
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO Failed
    to connect to previous supervisor.
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread agent INFO Trying
    to connect to newly launched supervisor (Attempt 1)
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread agent INFO
    Successfully connected to supervisor
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
    [03/Apr/2013:02:11:00] ENGINE Bus STARTING
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
    [03/Apr/2013:02:11:00] ENGINE Started monitor thread '_TimeoutMonitor'.
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
    [03/Apr/2013:02:11:00] ENGINE Serving on jonathan-K70IC:9000
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
    [03/Apr/2013:02:11:00] ENGINE Bus STARTED
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread __init__ INFO New
    monitor: (<cmf.monitor.host.hostmonitor object@0x20ffe50>,)
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread agent WARNING
    Setting default socket timeout to 30!
    [03/Apr/2013 02:11:00 +0000] 10736 MonitorDaemon-Scheduler __init__
    INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x20ffe50>,)


    Thanks in advance,
    Jonathan
  • Priebe Jonathan287 at Apr 3, 2013 at 3:45 pm
    You were right, changing the host to my local IP solved the problem.

    Thanks,
    Jonathan

    Am Mittwoch, 3. April 2013 03:22:32 UTC+2 schrieb Philip Zeyliger:
    Serving on jonathan-K70IC:9000
    Hi Jonathan,

    It looks like your host is identifying itself as 127.0.1.1, which is
    unlikely to work. Can you run the following for us?

    $python -c 'import socket; print socket.getfqdn(),
    socket.gethostbyname(socket.getfqdn())'
    p0427.mtv.cloudera.com 172.29.122.19

    Cheers,

    -- Philip



    On Tue, Apr 2, 2013 at 5:13 PM, <priebe.jo...@googlemail.com <javascript:>
    wrote:
    Hi,
    I'm having some troubles installing a host. My etc/hosts looks like this:

    127.0.0.1 localhost
    127.0.1.1 jonathan-K70IC
    192.168.178.22 masterserver

    # The following lines are desirable for IPv6 capable hosts
    ::1 ip6-localhost ip6-loopback
    fe00::0 ip6-localnet
    ff00::0 ip6-mcastprefix
    ff02::1 ip6-allnodes
    ff02::2 ip6-allrouters

    As suggested in some other threads I chose my local IP address namely
    masterserver as host. When I run the installation it returns "Installation
    failed. Failed to receive heartbeat from agent.".
    This is what is logged into
    var/log/cloudera-scm-agent/cloudera-scm-agent,log everytime I try to to
    install the host:

    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
    Stopping agent...
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO No
    cgrouped processes running; unmounting any cgroup roots
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO No
    processes are being managed; Supervisor will shutdown.
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
    Shutting down supervisord, pid 10052
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO
    Successfully shutdown supervisord, pid 10052
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus STOPPING
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('jonathan-K70IC', 9000)) shut down
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Stopped thread '_TimeoutMonitor'.
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus STOPPED
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus STOPPING
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE HTTP Server
    cherrypy._cpwsgi_server.CPWSGIServer(('jonathan-K70IC', 9000)) already shut
    down
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE No thread running for None.
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus STOPPED
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus EXITING
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread _cplogging INFO
    [03/Apr/2013:02:10:57] ENGINE Bus EXITED
    [03/Apr/2013 02:10:57 +0000] 10027 MainThread agent INFO Agent
    exiting; caught signal 15
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO No
    command line vars
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Agent
    starting as pid 10736 user root(0) group root(0).
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread downloader INFO
    Downloader path: /opt/cloudera/parcel-cache
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread parcel_cache INFO Using
    /opt/cloudera/parcel-cache for parcel cache
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO
    Reusing /run/cloudera-scm-agent/cgroups/memory
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO
    Reusing /run/cloudera-scm-agent/cgroups/cpu
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread cgroups INFO
    Reusing /run/cloudera-scm-agent/cgroups/blkio
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Found
    cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes':
    9223372036854775807, 'writable_cgroup_dot_procs': True, 'has_cpu': True,
    'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_blkio': True}
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO
    Setting up eager heartbeat event monitor.
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
    Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
    Using timeout of 2.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
    Using join timeout of 0.100000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread filesystem_map INFO
    Using tolerance of 60.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
    metrics_url_timeout_seconds of 30.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
    task_metrics_timeout_seconds of 5.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread agent INFO Using
    max_collection_wait_seconds of 10.000000
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread metrics INFO
    Importing tasktracker metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
    [03/Apr/2013 02:10:58 +0000] 10736 MainThread __init__ INFO
    Importing metric schema from file
    /usr/lib/cmf/agent/src/cmf/monitor/schema.json
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Supervised processes will inherit the following environment:
    {'CMF_CONF_DIR': '/etc/cloudera-scm-agent', 'CMF_AGENT_HIVE_DEFAULT_XML':
    '/etc/hive/conf.dist/hive-default.xml', 'CMF_AGENT_MGMT_HOME':
    '/usr/share/cmf', 'CMF_AGENT_CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'PATH':
    '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games',
    'CMF_AGENT_CDH_FLUME_HOME': '/usr/lib/flume-ng',
    'CMF_AGENT_CDH_HBASE_HOME': '/usr/lib/hbase', 'LANG': 'en_US.UTF-8',
    'TERM': 'vt100', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CMF_AGENT_CDH_HUE_HOME':
    '/usr/share/hue', 'SHLVL': '1', 'CMF_AGENT_TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar',
    'CMF_AGENT_CDH_PIG_HOME': '/usr/lib/pig', 'CMF_AGENT_CDH_HIVE_HOME':
    '/usr/lib/hive', 'CLOUDERA_MYSQL_CONNECTOR_JAR':
    '/usr/share/java/mysql-connector-java.jar', 'CMF_AGENT_CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CMF_AGENT_CDH_HADOOP_BIN': '/usr/bin/hadoop',
    'CMF_AGENT_CDH_OOZIE_HOME': '/usr/lib/oozie',
    'CMF_AGENT_CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper',
    'CMF_AGENT_CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_AGENT_JSVC_HOME':
    '/usr/libexec/bigtop-utils', 'CMF_AGENT_CDH_HDFS_HOME':
    '/usr/lib/hadoop-hdfs', 'CMF_AGENT_CDH_MR1_HOME':
    '/usr/lib/hadoop-0.20-mapreduce', 'CMF_AGENT_CDH_MR2_HOME':
    '/usr/lib/hadoop-mapreduce', 'PWD': '/', 'CMF_AGENT_CDH_HADOOP_HOME':
    '/usr/lib/hadoop', 'CMF_AGENT_CDH_IMPALA_HOME': '/usr/lib/impala'}
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Supervised processes will add the following their environment environment:
    {'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CMF_PACKAGE_DIR':
    '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME':
    '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME':
    '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs',
    'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE
    HDFS_DFS_DIR_NOT_EMPTY', 'CLOUDERA_ORACLE_CONNECTOR_JAR':
    '/usr/share/java/oracle-connector-java.jar', 'CDH_HIVE_HOME':
    '/usr/lib/hive', 'JSVC_HOME': '/usr/libexec/bigtop-utils',
    'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml',
    'CLOUDERA_POSTGRESQL_JDBC_JAR':
    '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_HBASE_HOME':
    '/usr/lib/hbase', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME':
    '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue',
    'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar',
    'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_PIG_HOME':
    '/usr/lib/pig', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs',
    'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'TOMCAT_HOME':
    '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/process
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
    [03/Apr/2013 02:10:59 +0000] 10736 MainThread agent INFO
    Failed to connect to previous supervisor.
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread agent INFO
    Trying to connect to newly launched supervisor (Attempt 1)
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread agent INFO
    Successfully connected to supervisor
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
    [03/Apr/2013:02:11:00] ENGINE Bus STARTING
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
    [03/Apr/2013:02:11:00] ENGINE Started monitor thread '_TimeoutMonitor'.
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
    [03/Apr/2013:02:11:00] ENGINE Serving on jonathan-K70IC:9000
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread _cplogging INFO
    [03/Apr/2013:02:11:00] ENGINE Bus STARTED
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread __init__ INFO New
    monitor: (<cmf.monitor.host.hostmonitor object@0x20ffe50>,)
    [03/Apr/2013 02:11:00 +0000] 10736 MainThread agent WARNING
    Setting default socket timeout to 30!
    [03/Apr/2013 02:11:00 +0000] 10736 MonitorDaemon-Scheduler __init__
    INFO Monitor ready to report: (<cmf.monitor.host.HostMonitor object at
    0x20ffe50>,)


    Thanks in advance,
    Jonathan

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedApr 3, '13 at 12:14a
activeApr 3, '13 at 3:45p
posts3
users2
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase