FAQ
The OS I am installing on on EC2 is RedHat Enterprise Server.

towards the end, there was the error of ">>agent.py: error: argument
--hostname is required "

I googled it and found some chatter on it, looks like there is a bug of
some sort, right here on this forum.
  https://groups.google.com/a/cloudera.org/forum/#!topic/scm-users/-S6VxPDby0I

Help please....

Thanks

Sean


Here is the full log....

===================


/tmp/scm_prepare_node.LqcsQpvP

using SSH_CLIENT to get the SCM hostname: 172.31.39.35 51944 22

opening logging file descriptor

Starting installation script...

Acquiring installation lock...

BEGIN flock 4

END (0)

Detecting root privileges...

effective UID is 500

BEGIN which pbrun

which: no pbrun in (/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin)

END (1)

BEGIN sudo -S id

uid=0(root) gid=0(root) groups=0(root)
context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023

END (0)

Using 'sudo ' to acquire root privileges

Detecting distribution...

BEGIN grep Tikanga /etc/redhat-release

END (1)

BEGIN grep 'CentOS release 5' /etc/redhat-release

END (1)

BEGIN grep 'Scientific Linux release 5' /etc/redhat-release

END (1)

BEGIN grep Santiago /etc/redhat-release

Red Hat Enterprise Linux Server release 6.4 (Santiago)

END (0)

/etc/redhat-release ==> RHEL 6

Detecting Cloudera Manager Server...

BEGIN host -t PTR 172.31.39.35

35.39.31.172.in-addr.arpa domain name pointer ip-172-31-39-35.ec2.internal.

END (0)

using ip-172-31-39-35.ec2.internal as scm server hostname

BEGIN which python

END (0)

BEGIN python -c 'import socket; import sys; s =
socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1],
int(sys.argv[2]))); s.close();' ip-172-31-39-35.ec2.internal 7182

/usr/bin/python

END (0)

BEGIN which wget

/usr/bin/wget

END (0)

BEGIN wget -qO- -T 1 -t 1
http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo

ec2-54-209-121-60.compute-1.amazonaws.com

END (0)

BEGIN wget -qO- -T 1 -t 1
http://169.254.169.254/latest/meta-data/instance-id && /bin/echo

i-ae804ad2

END (0)

Performing cloud-specific configuration...

BEGIN sudo /sbin/chkconfig iptables

END (1)

BEGIN sudo /sbin/service iptables status | grep Chain

END (1)

BEGIN sudo getenforce

Permissive

END (0)

BEGIN grep -e ^SELINUX=enforcing /etc/selinux/config

END (1)

BEGIN df -h | grep -o -E "^/dev/[^[:space:]]*"

/dev/xvde1

END (0)

BEGIN awk 'FNR > 2 {print $NF}' /proc/partitions

xvde1

END (0)

Installing package repositories...

validating format of repository file
/tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo

installing repository file
/tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo

repository file
/tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo installed

Refreshing package metadata...

BEGIN sudo yum clean all

Loaded plugins: amazon-id, rhui-lb, security

Cleaning repos: cdh-solr cloudera-cdh4 cloudera-impala cloudera-manager

: rhui-REGION-client-config-server-6

: rhui-REGION-rhel-server-releases

: rhui-REGION-rhel-server-releases-optional

Cleaning up Everything

END (0)

BEGIN sudo rm -Rf /var/cache/yum/x86_64

END (0)

BEGIN sudo yum makecache

Loaded plugins: amazon-id, rhui-lb, security

Metadata Cache Created

END (0)

Installing jdk package...

BEGIN sudo yum list installed jdk

Loaded plugins: amazon-id, rhui-lb, security

Installed Packages

jdk.x86_64 2000:1.6.0_31-fcs @cloudera-manager

END (0)

BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep jdk

END (0)

jdk cloudera-manager-agent cloudera-manager-daemons

BEGIN sudo yum info jdk

Loaded plugins: amazon-id, rhui-lb, security

Installed Packages

Name : jdk

Arch : x86_64

Epoch : 2000

Version : 1.6.0_31

Release : fcs

Size : 143 M

Repo : installed

From repo : cloudera-manager

Summary : Java(TM) Platform Standard Edition Development Kit

URL : http://java.sun.com/

License : Copyright (c) 2011, Oracle and/or its affiliates. All rights

: reserved. Also under other license(s) as shown at the Description

: field.

Description : The Java Platform Standard Edition Development Kit (JDK)
includes

: both the runtime environment (Java virtual machine, the Java

: platform classes and supporting files) and development tools

: (compilers, debuggers, tool libraries and other tools).

:

: The JDK is a development environment for building applications,

: applets and components that can be deployed with the Java Platform

: Standard Edition Runtime Environment.


END (0)

BEGIN sudo yum -y install jdk.x86_64

Loaded plugins: amazon-id, rhui-lb, security

Setting up Install Process

Package 2000:jdk-1.6.0_31-fcs.x86_64 already installed and latest version

Nothing to do

END (0)

remote package jdk installed

Installing cloudera-manager-agent package...

BEGIN sudo yum list installed cloudera-manager-agent

Loaded plugins: amazon-id, rhui-lb, security

Installed Packages

cloudera-manager-agent.x86_64 4.8.0-1.cm480.p0.50.el6 @cloudera-manager

END (0)

BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
cloudera-manager-agent

END (0)

jdk cloudera-manager-agent cloudera-manager-daemons

BEGIN sudo yum info cloudera-manager-agent

Loaded plugins: amazon-id, rhui-lb, security

Installed Packages

Name : cloudera-manager-agent

Arch : x86_64

Version : 4.8.0

Release : 1.cm480.p0.50.el6

Size : 25 M

Repo : installed

From repo : cloudera-manager

Summary : The Cloudera Manager Agent

URL : http://www.cloudera.com

License : Proprietary

Description : The Cloudera Manager Agent.

:

: The Agent is deployed to machines running services managed by

: Cloudera Manager.


END (0)

Version : 4.8.0

Release : 1.cm480.p0.50.el6

BEGIN sudo yum -y install cloudera-manager-agent

Loaded plugins: amazon-id, rhui-lb, security

Setting up Install Process

Package cloudera-manager-agent-4.8.0-1.cm480.p0.50.el6.x86_64 already
installed and latest version

Nothing to do

END (0)

remote package cloudera-manager-agent installed

Installing cloudera-manager-daemons package...

BEGIN sudo yum list installed cloudera-manager-daemons

Loaded plugins: amazon-id, rhui-lb, security

Installed Packages

cloudera-manager-daemons.x86_64 4.8.0-1.cm480.p0.50.el6 @cloudera-manager

END (0)

BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
cloudera-manager-daemons

jdk cloudera-manager-agent cloudera-manager-daemons

END (0)

BEGIN sudo yum info cloudera-manager-daemons

Loaded plugins: amazon-id, rhui-lb, security

Installed Packages

Name : cloudera-manager-daemons

Arch : x86_64

Version : 4.8.0

Release : 1.cm480.p0.50.el6

Size : 201 M

Repo : installed

From repo : cloudera-manager

Summary : Provides daemons for monitoring Hadoop and related tools.

URL : http://www.cloudera.com

License : Proprietary

Description : This package includes daemons for monitoring and managing
Hadoop.


END (0)

Version : 4.8.0

Release : 1.cm480.p0.50.el6

BEGIN sudo yum -y install cloudera-manager-daemons

Loaded plugins: amazon-id, rhui-lb, security

Setting up Install Process

Package cloudera-manager-daemons-4.8.0-1.cm480.p0.50.el6.x86_64 already
installed and latest version

Nothing to do

END (0)

remote package cloudera-manager-daemons installed

Configuring Cloudera Manager Agent...

BEGIN sudo sed -e 's/\(CMF_AGENT_ARGS=\).*/\1"--host_id i-ae804ad2"/' -i
/etc/default/cloudera-scm-agent

END (0)

BEGIN grep server_host=ip-172-31-39-35.ec2.internal
/etc/cloudera-scm-agent/config.ini

END (0)

scm agent is already configured

Starting Cloudera Manager Agent...

BEGIN /sbin/service cloudera-scm-agent status | grep running

server_host=ip-172-31-39-35.ec2.internal

END (1)

BEGIN sudo /sbin/service cloudera-scm-agent start

Starting cloudera-scm-agent: ILEgent logs:

BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out |
sed 's/^/>>/'
/usr/lib64/cmf/agent/src/cmf/parcel.py:15: DeprecationWarning: the sets
module is deprecated
from sets import Set
/usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha
module is deprecated; use the hashlib module instead
import sha
[04/Dec/2013 20:15:47 +0000] 9476 MainThread agent INFO SCM Agent
Version: 4.8.0
[04/Dec/2013 20:15:47 +0000] 9476 MainThread agent ERROR Could not
determine hostname or ip address; proceeding.
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1600, in
parse_arguments
ip_address = socket.gethostbyname(fqdn)
gaierror: [Errno -2] Name or service not known
usage: agent.py [-h] [--agent_dir AGENT_DIR]
[--agent_httpd_port AGENT_HTTPD_PORT] --package_dir
PACKAGE_DIR [--parcel_dir PARCEL_DIR]
[--supervisord_path SUPERVISORD_PATH]
[--supervisord_httpd_port SUPERVISORD_HTTPD_PORT]
[--standalone STANDALONE] [--master MASTER]
[--environment ENVIRONMENT] [--host_id HOST_ID]
[--disable_supervisord_events] --hostname HOSTNAME
--ip_address IP_ADDRESS [--use_tls]
[--client_key_file CLIENT_KEY_FILE]
[--client_cert_file CLIENT_CERT_FILE]
[--verify_cert_file VERIFY_CERT_FILE]
[--client_keypw_file CLIENT_KEYPW_FILE] [--logfile LOGFILE]
[--logdir LOGDIR] [--optional_token] [--clear_agent_dir]
agent.py: error: argument --hostname is required
[04/Dec/2013 20:15:47 +0000] 9476 Dummy-1 agent INFO Stopping agent...
/usr/lib64/cmf/agent/src/cmf/parcel.py:15: DeprecationWarning: the sets
module is deprecated
from sets import Set
/usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha
module is deprecated; use the hashlib module instead
import sha
[04/Dec/2013 20:15:47 +0000] 9476 MainThread agent INFO SCM Agent
Version: 4.8.0
[04/Dec/2013 20:15:47 +0000] 9476 MainThread agent ERROR Could not
determine hostname or ip address; proceeding.
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1600, in
parse_arguments
ip_address = socket.gethostbyname(fqdn)
gaierror: [Errno -2] Name or service not known
usage: agent.py [-h] [--agent_dir AGENT_DIR]
[--agent_httpd_port AGENT_HTTPD_PORT] --package_dir
PACKAGE_DIR [--parcel_dir PARCEL_DIR]
[--supervisord_path SUPERVISORD_PATH]
[--supervisord_httpd_port SUPERVISORD_HTTPD_PORT]
[--standalone STANDALONE] [--master MASTER]
[--environment ENVIRONMENT] [--host_id HOST_ID]
[--disable_supervisord_events] --hostname HOSTNAME
--ip_address IP_ADDRESS [--use_tls]
[--client_key_file CLIENT_KEY_FILE]
[--client_cert_file CLIENT_CERT_FILE]
[--verify_cert_file VERIFY_CERT_FILE]
[--client_keypw_file CLIENT_KEYPW_FILE] [--logfile LOGFILE]
[--logdir LOGDIR] [--optional_token] [--clear_agent_dir]
agent.py: error: argument --hostname is required
[04/Dec/2013 20:15:47 +0000] 9476 Dummy-1 agent INFO Stopping agent...
END (0)

BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log |
sed 's/^/>>/'

tail: tail: cannot open
`/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for readingcannot
open `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for reading: No
such file or directory: No such file or directory


END (0)

end of agent logs.

scm agent could not be started, giving up

waiting for rollback request

   Close

  Back 1 2 3 4 5 Continue


To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Search Discussions

  • Philip Zeyliger at Dec 9, 2013 at 6:58 pm

    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1600, in
    parse_arguments
    ip_address = socket.gethostbyname(fqdn)
    That tells us that your host can't resolve itself. You can run this
    standalone like so:

    python -c 'import socket; print socket.getfqdn(),
    socket.gethostbyname(socket.getfqdn())'

    Check your DNS settings.



    On Wed, Dec 4, 2013 at 5:32 PM, Sean T Shen wrote:

    The OS I am installing on on EC2 is RedHat Enterprise Server.

    towards the end, there was the error of ">>agent.py: error: argument
    --hostname is required "

    I googled it and found some chatter on it, looks like there is a bug of
    some sort, right here on this forum.
    https://groups.google.com/a/cloudera.org/forum/#!topic/scm-users/-S6VxPDby0I

    Help please....

    Thanks

    Sean


    Here is the full log....

    ===================


    /tmp/scm_prepare_node.LqcsQpvP

    using SSH_CLIENT to get the SCM hostname: 172.31.39.35 51944 22

    opening logging file descriptor

    Starting installation script...

    Acquiring installation lock...

    BEGIN flock 4

    END (0)

    Detecting root privileges...

    effective UID is 500

    BEGIN which pbrun

    which: no pbrun in (/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin)

    END (1)

    BEGIN sudo -S id

    uid=0(root) gid=0(root) groups=0(root)
    context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023

    END (0)

    Using 'sudo ' to acquire root privileges

    Detecting distribution...

    BEGIN grep Tikanga /etc/redhat-release

    END (1)

    BEGIN grep 'CentOS release 5' /etc/redhat-release

    END (1)

    BEGIN grep 'Scientific Linux release 5' /etc/redhat-release

    END (1)

    BEGIN grep Santiago /etc/redhat-release

    Red Hat Enterprise Linux Server release 6.4 (Santiago)

    END (0)

    /etc/redhat-release ==> RHEL 6

    Detecting Cloudera Manager Server...

    BEGIN host -t PTR 172.31.39.35

    35.39.31.172.in-addr.arpa domain name pointer
    ip-172-31-39-35.ec2.internal.

    END (0)

    using ip-172-31-39-35.ec2.internal as scm server hostname

    BEGIN which python

    END (0)

    BEGIN python -c 'import socket; import sys; s =
    socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1],
    int(sys.argv[2]))); s.close();' ip-172-31-39-35.ec2.internal 7182

    /usr/bin/python

    END (0)

    BEGIN which wget

    /usr/bin/wget

    END (0)

    BEGIN wget -qO- -T 1 -t 1
    http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo

    ec2-54-209-121-60.compute-1.amazonaws.com

    END (0)

    BEGIN wget -qO- -T 1 -t 1
    http://169.254.169.254/latest/meta-data/instance-id && /bin/echo

    i-ae804ad2

    END (0)

    Performing cloud-specific configuration...

    BEGIN sudo /sbin/chkconfig iptables

    END (1)

    BEGIN sudo /sbin/service iptables status | grep Chain

    END (1)

    BEGIN sudo getenforce

    Permissive

    END (0)

    BEGIN grep -e ^SELINUX=enforcing /etc/selinux/config

    END (1)

    BEGIN df -h | grep -o -E "^/dev/[^[:space:]]*"

    /dev/xvde1

    END (0)

    BEGIN awk 'FNR > 2 {print $NF}' /proc/partitions

    xvde1

    END (0)

    Installing package repositories...

    validating format of repository file
    /tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo

    installing repository file
    /tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo

    repository file
    /tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo installed

    Refreshing package metadata...

    BEGIN sudo yum clean all

    Loaded plugins: amazon-id, rhui-lb, security

    Cleaning repos: cdh-solr cloudera-cdh4 cloudera-impala cloudera-manager

    : rhui-REGION-client-config-server-6

    : rhui-REGION-rhel-server-releases

    : rhui-REGION-rhel-server-releases-optional

    Cleaning up Everything

    END (0)

    BEGIN sudo rm -Rf /var/cache/yum/x86_64

    END (0)

    BEGIN sudo yum makecache

    Loaded plugins: amazon-id, rhui-lb, security

    Metadata Cache Created

    END (0)

    Installing jdk package...

    BEGIN sudo yum list installed jdk

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    jdk.x86_64 2000:1.6.0_31-fcs @cloudera-manager

    END (0)

    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep jdk

    END (0)

    jdk cloudera-manager-agent cloudera-manager-daemons

    BEGIN sudo yum info jdk

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    Name : jdk

    Arch : x86_64

    Epoch : 2000

    Version : 1.6.0_31

    Release : fcs

    Size : 143 M

    Repo : installed

    From repo : cloudera-manager

    Summary : Java(TM) Platform Standard Edition Development Kit

    URL : http://java.sun.com/

    License : Copyright (c) 2011, Oracle and/or its affiliates. All rights

    : reserved. Also under other license(s) as shown at the Description

    : field.

    Description : The Java Platform Standard Edition Development Kit (JDK)
    includes

    : both the runtime environment (Java virtual machine, the Java

    : platform classes and supporting files) and development tools

    : (compilers, debuggers, tool libraries and other tools).

    :

    : The JDK is a development environment for building applications,

    : applets and components that can be deployed with the Java Platform

    : Standard Edition Runtime Environment.


    END (0)

    BEGIN sudo yum -y install jdk.x86_64

    Loaded plugins: amazon-id, rhui-lb, security

    Setting up Install Process

    Package 2000:jdk-1.6.0_31-fcs.x86_64 already installed and latest version

    Nothing to do

    END (0)

    remote package jdk installed

    Installing cloudera-manager-agent package...

    BEGIN sudo yum list installed cloudera-manager-agent

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    cloudera-manager-agent.x86_64 4.8.0-1.cm480.p0.50.el6 @cloudera-manager

    END (0)

    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
    cloudera-manager-agent

    END (0)

    jdk cloudera-manager-agent cloudera-manager-daemons

    BEGIN sudo yum info cloudera-manager-agent

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    Name : cloudera-manager-agent

    Arch : x86_64

    Version : 4.8.0

    Release : 1.cm480.p0.50.el6

    Size : 25 M

    Repo : installed

    From repo : cloudera-manager

    Summary : The Cloudera Manager Agent

    URL : http://www.cloudera.com

    License : Proprietary

    Description : The Cloudera Manager Agent.

    :

    : The Agent is deployed to machines running services managed by

    : Cloudera Manager.


    END (0)

    Version : 4.8.0

    Release : 1.cm480.p0.50.el6

    BEGIN sudo yum -y install cloudera-manager-agent

    Loaded plugins: amazon-id, rhui-lb, security

    Setting up Install Process

    Package cloudera-manager-agent-4.8.0-1.cm480.p0.50.el6.x86_64 already
    installed and latest version

    Nothing to do

    END (0)

    remote package cloudera-manager-agent installed

    Installing cloudera-manager-daemons package...

    BEGIN sudo yum list installed cloudera-manager-daemons

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    cloudera-manager-daemons.x86_64 4.8.0-1.cm480.p0.50.el6 @cloudera-manager

    END (0)

    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
    cloudera-manager-daemons

    jdk cloudera-manager-agent cloudera-manager-daemons

    END (0)

    BEGIN sudo yum info cloudera-manager-daemons

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    Name : cloudera-manager-daemons

    Arch : x86_64

    Version : 4.8.0

    Release : 1.cm480.p0.50.el6

    Size : 201 M

    Repo : installed

    From repo : cloudera-manager

    Summary : Provides daemons for monitoring Hadoop and related tools.

    URL : http://www.cloudera.com

    License : Proprietary

    Description : This package includes daemons for monitoring and managing
    Hadoop.


    END (0)

    Version : 4.8.0

    Release : 1.cm480.p0.50.el6

    BEGIN sudo yum -y install cloudera-manager-daemons

    Loaded plugins: amazon-id, rhui-lb, security

    Setting up Install Process

    Package cloudera-manager-daemons-4.8.0-1.cm480.p0.50.el6.x86_64 already
    installed and latest version

    Nothing to do

    END (0)

    remote package cloudera-manager-daemons installed

    Configuring Cloudera Manager Agent...

    BEGIN sudo sed -e 's/\(CMF_AGENT_ARGS=\).*/\1"--host_id i-ae804ad2"/' -i
    /etc/default/cloudera-scm-agent

    END (0)

    BEGIN grep server_host=ip-172-31-39-35.ec2.internal
    /etc/cloudera-scm-agent/config.ini

    END (0)

    scm agent is already configured

    Starting Cloudera Manager Agent...

    BEGIN /sbin/service cloudera-scm-agent status | grep running

    server_host=ip-172-31-39-35.ec2.internal

    END (1)

    BEGIN sudo /sbin/service cloudera-scm-agent start

    Starting cloudera-scm-agent: ILEgent logs:

    BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out
    sed 's/^/>>/'
    /usr/lib64/cmf/agent/src/cmf/parcel.py:15: DeprecationWarning: the sets
    module is deprecated
    from sets import Set
    /usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha
    module is deprecated; use the hashlib module instead
    import sha
    [04/Dec/2013 20:15:47 +0000] 9476 MainThread agent INFO SCM Agent
    Version: 4.8.0
    [04/Dec/2013 20:15:47 +0000] 9476 MainThread agent ERROR Could not
    determine hostname or ip address; proceeding.
    Traceback (most recent call last):
    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1600, in
    parse_arguments
    ip_address = socket.gethostbyname(fqdn)
    gaierror: [Errno -2] Name or service not known
    usage: agent.py [-h] [--agent_dir AGENT_DIR]
    [--agent_httpd_port AGENT_HTTPD_PORT] --package_dir
    PACKAGE_DIR [--parcel_dir PARCEL_DIR]
    [--supervisord_path SUPERVISORD_PATH]
    [--supervisord_httpd_port SUPERVISORD_HTTPD_PORT]
    [--standalone STANDALONE] [--master MASTER]
    [--environment ENVIRONMENT] [--host_id HOST_ID]
    [--disable_supervisord_events] --hostname HOSTNAME
    --ip_address IP_ADDRESS [--use_tls]
    [--client_key_file CLIENT_KEY_FILE]
    [--client_cert_file CLIENT_CERT_FILE]
    [--verify_cert_file VERIFY_CERT_FILE]
    [--client_keypw_file CLIENT_KEYPW_FILE] [--logfile LOGFILE]
    [--logdir LOGDIR] [--optional_token] [--clear_agent_dir]
    agent.py: error: argument --hostname is required
    [04/Dec/2013 20:15:47 +0000] 9476 Dummy-1 agent INFO Stopping agent...
    /usr/lib64/cmf/agent/src/cmf/parcel.py:15: DeprecationWarning: the sets
    module is deprecated
    from sets import Set
    /usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha
    module is deprecated; use the hashlib module instead
    import sha
    [04/Dec/2013 20:15:47 +0000] 9476 MainThread agent INFO SCM Agent
    Version: 4.8.0
    [04/Dec/2013 20:15:47 +0000] 9476 MainThread agent ERROR Could not
    determine hostname or ip address; proceeding.
    Traceback (most recent call last):
    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1600, in
    parse_arguments
    ip_address = socket.gethostbyname(fqdn)
    gaierror: [Errno -2] Name or service not known
    usage: agent.py [-h] [--agent_dir AGENT_DIR]
    [--agent_httpd_port AGENT_HTTPD_PORT] --package_dir
    PACKAGE_DIR [--parcel_dir PARCEL_DIR]
    [--supervisord_path SUPERVISORD_PATH]
    [--supervisord_httpd_port SUPERVISORD_HTTPD_PORT]
    [--standalone STANDALONE] [--master MASTER]
    [--environment ENVIRONMENT] [--host_id HOST_ID]
    [--disable_supervisord_events] --hostname HOSTNAME
    --ip_address IP_ADDRESS [--use_tls]
    [--client_key_file CLIENT_KEY_FILE]
    [--client_cert_file CLIENT_CERT_FILE]
    [--verify_cert_file VERIFY_CERT_FILE]
    [--client_keypw_file CLIENT_KEYPW_FILE] [--logfile LOGFILE]
    [--logdir LOGDIR] [--optional_token] [--clear_agent_dir]
    agent.py: error: argument --hostname is required
    [04/Dec/2013 20:15:47 +0000] 9476 Dummy-1 agent INFO Stopping agent...
    END (0)

    BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log
    sed 's/^/>>/'
    tail: tail: cannot open
    `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for readingcannot
    open `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for reading: No
    such file or directory: No such file or directory


    END (0)

    end of agent logs.

    scm agent could not be started, giving up

    waiting for rollback request

    Close

    Back 1 2 3 4 5 Continue


    To unsubscribe from this group and stop receiving emails from it, send an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Sean T Shen at Dec 9, 2013 at 11:18 pm
    Thanks to all. I was able to fix this issue...with the following actions

    1. I noticed that the internal hostname as displayed on Cloudera manager is
    something like this: ip-172-31-36-231.ec2.internal, yet the actual hostname
    after
    I logged in, is ip-172-31-36-231.localdomain. And uname -a also shows
    ip-172-31-36-231.ec2.internal. And there was some chatter on the web about
    this also.
    So I tried this:

    ===== I edited the /etc/sysconfig/network file (I am on RedHat) so that it
    will use ip-172-31-36-231.ec2.internal, to match what Cloudera is expecting.
    And I did this for all the 3 hosts that are the nodes of my cluster.

    2. To make sure all the other hosts involved in the cluster can see the
    new names (I have one host that I installed and runs Cloudera Manager and 3
    hosts to make up the cluster nodes), I have added the following lines

    172.31.46.172 ip-172-31-46-172.ec2.internal

    172.31.36.230 ip-172-31-36-230.ec2.internal

    172.31.36.231 ip-172-31-36-231.ec2.internal

    172.31.36.229 ip-172-31-36-229.ec2.internal


    After that, all installs went through fine, and when I bring up Cloudera
    Manager to look at them, they all showed as healthy.


    I was wondering why Amazon used this ip-172-31-36-231.localdomain as local
    host names, and why Cloudera expected ip-172-31-36-231.ec2.internal, why
    this discrepancy. Is this an Amazon problem/bug, or should Cloudera have
    expected this and adjusted the installation procedure accordingly.


    Thanks

    Sean



    On Mon, Dec 9, 2013 at 1:58 PM, Philip Zeyliger wrote:

    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1600, in
    parse_arguments
    ip_address = socket.gethostbyname(fqdn)
    That tells us that your host can't resolve itself. You can run this
    standalone like so:

    python -c 'import socket; print socket.getfqdn(),
    socket.gethostbyname(socket.getfqdn())'

    Check your DNS settings.



    On Wed, Dec 4, 2013 at 5:32 PM, Sean T Shen wrote:

    The OS I am installing on on EC2 is RedHat Enterprise Server.

    towards the end, there was the error of ">>agent.py: error: argument
    --hostname is required "

    I googled it and found some chatter on it, looks like there is a bug of
    some sort, right here on this forum.
    https://groups.google.com/a/cloudera.org/forum/#!topic/scm-users/-S6VxPDby0I

    Help please....

    Thanks

    Sean


    Here is the full log....

    ===================


    /tmp/scm_prepare_node.LqcsQpvP

    using SSH_CLIENT to get the SCM hostname: 172.31.39.35 51944 22

    opening logging file descriptor

    Starting installation script...

    Acquiring installation lock...

    BEGIN flock 4

    END (0)

    Detecting root privileges...

    effective UID is 500

    BEGIN which pbrun

    which: no pbrun in (/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin)

    END (1)

    BEGIN sudo -S id

    uid=0(root) gid=0(root) groups=0(root)
    context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023

    END (0)

    Using 'sudo ' to acquire root privileges

    Detecting distribution...

    BEGIN grep Tikanga /etc/redhat-release

    END (1)

    BEGIN grep 'CentOS release 5' /etc/redhat-release

    END (1)

    BEGIN grep 'Scientific Linux release 5' /etc/redhat-release

    END (1)

    BEGIN grep Santiago /etc/redhat-release

    Red Hat Enterprise Linux Server release 6.4 (Santiago)

    END (0)

    /etc/redhat-release ==> RHEL 6

    Detecting Cloudera Manager Server...

    BEGIN host -t PTR 172.31.39.35

    35.39.31.172.in-addr.arpa domain name pointer
    ip-172-31-39-35.ec2.internal.

    END (0)

    using ip-172-31-39-35.ec2.internal as scm server hostname

    BEGIN which python

    END (0)

    BEGIN python -c 'import socket; import sys; s =
    socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1],
    int(sys.argv[2]))); s.close();' ip-172-31-39-35.ec2.internal 7182

    /usr/bin/python

    END (0)

    BEGIN which wget

    /usr/bin/wget

    END (0)

    BEGIN wget -qO- -T 1 -t 1
    http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo

    ec2-54-209-121-60.compute-1.amazonaws.com

    END (0)

    BEGIN wget -qO- -T 1 -t 1
    http://169.254.169.254/latest/meta-data/instance-id && /bin/echo

    i-ae804ad2

    END (0)

    Performing cloud-specific configuration...

    BEGIN sudo /sbin/chkconfig iptables

    END (1)

    BEGIN sudo /sbin/service iptables status | grep Chain

    END (1)

    BEGIN sudo getenforce

    Permissive

    END (0)

    BEGIN grep -e ^SELINUX=enforcing /etc/selinux/config

    END (1)

    BEGIN df -h | grep -o -E "^/dev/[^[:space:]]*"

    /dev/xvde1

    END (0)

    BEGIN awk 'FNR > 2 {print $NF}' /proc/partitions

    xvde1

    END (0)

    Installing package repositories...

    validating format of repository file
    /tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo

    installing repository file
    /tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo

    repository file
    /tmp/scm_prepare_node.LqcsQpvP/repos/rhel6/cloudera-manager.repo installed

    Refreshing package metadata...

    BEGIN sudo yum clean all

    Loaded plugins: amazon-id, rhui-lb, security

    Cleaning repos: cdh-solr cloudera-cdh4 cloudera-impala cloudera-manager

    : rhui-REGION-client-config-server-6

    : rhui-REGION-rhel-server-releases

    : rhui-REGION-rhel-server-releases-optional

    Cleaning up Everything

    END (0)

    BEGIN sudo rm -Rf /var/cache/yum/x86_64

    END (0)

    BEGIN sudo yum makecache

    Loaded plugins: amazon-id, rhui-lb, security

    Metadata Cache Created

    END (0)

    Installing jdk package...

    BEGIN sudo yum list installed jdk

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    jdk.x86_64 2000:1.6.0_31-fcs @cloudera-manager

    END (0)

    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep jdk

    END (0)

    jdk cloudera-manager-agent cloudera-manager-daemons

    BEGIN sudo yum info jdk

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    Name : jdk

    Arch : x86_64

    Epoch : 2000

    Version : 1.6.0_31

    Release : fcs

    Size : 143 M

    Repo : installed

    From repo : cloudera-manager

    Summary : Java(TM) Platform Standard Edition Development Kit

    URL : http://java.sun.com/

    License : Copyright (c) 2011, Oracle and/or its affiliates. All rights

    : reserved. Also under other license(s) as shown at the Description

    : field.

    Description : The Java Platform Standard Edition Development Kit (JDK)
    includes

    : both the runtime environment (Java virtual machine, the Java

    : platform classes and supporting files) and development tools

    : (compilers, debuggers, tool libraries and other tools).

    :

    : The JDK is a development environment for building applications,

    : applets and components that can be deployed with the Java Platform

    : Standard Edition Runtime Environment.


    END (0)

    BEGIN sudo yum -y install jdk.x86_64

    Loaded plugins: amazon-id, rhui-lb, security

    Setting up Install Process

    Package 2000:jdk-1.6.0_31-fcs.x86_64 already installed and latest version

    Nothing to do

    END (0)

    remote package jdk installed

    Installing cloudera-manager-agent package...

    BEGIN sudo yum list installed cloudera-manager-agent

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    cloudera-manager-agent.x86_64 4.8.0-1.cm480.p0.50.el6 @cloudera-manager

    END (0)

    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
    cloudera-manager-agent

    END (0)

    jdk cloudera-manager-agent cloudera-manager-daemons

    BEGIN sudo yum info cloudera-manager-agent

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    Name : cloudera-manager-agent

    Arch : x86_64

    Version : 4.8.0

    Release : 1.cm480.p0.50.el6

    Size : 25 M

    Repo : installed

    From repo : cloudera-manager

    Summary : The Cloudera Manager Agent

    URL : http://www.cloudera.com

    License : Proprietary

    Description : The Cloudera Manager Agent.

    :

    : The Agent is deployed to machines running services managed by

    : Cloudera Manager.


    END (0)

    Version : 4.8.0

    Release : 1.cm480.p0.50.el6

    BEGIN sudo yum -y install cloudera-manager-agent

    Loaded plugins: amazon-id, rhui-lb, security

    Setting up Install Process

    Package cloudera-manager-agent-4.8.0-1.cm480.p0.50.el6.x86_64 already
    installed and latest version

    Nothing to do

    END (0)

    remote package cloudera-manager-agent installed

    Installing cloudera-manager-daemons package...

    BEGIN sudo yum list installed cloudera-manager-daemons

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    cloudera-manager-daemons.x86_64 4.8.0-1.cm480.p0.50.el6 @cloudera-manager

    END (0)

    BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep
    cloudera-manager-daemons

    jdk cloudera-manager-agent cloudera-manager-daemons

    END (0)

    BEGIN sudo yum info cloudera-manager-daemons

    Loaded plugins: amazon-id, rhui-lb, security

    Installed Packages

    Name : cloudera-manager-daemons

    Arch : x86_64

    Version : 4.8.0

    Release : 1.cm480.p0.50.el6

    Size : 201 M

    Repo : installed

    From repo : cloudera-manager

    Summary : Provides daemons for monitoring Hadoop and related tools.

    URL : http://www.cloudera.com

    License : Proprietary

    Description : This package includes daemons for monitoring and managing
    Hadoop.


    END (0)

    Version : 4.8.0

    Release : 1.cm480.p0.50.el6

    BEGIN sudo yum -y install cloudera-manager-daemons

    Loaded plugins: amazon-id, rhui-lb, security

    Setting up Install Process

    Package cloudera-manager-daemons-4.8.0-1.cm480.p0.50.el6.x86_64 already
    installed and latest version

    Nothing to do

    END (0)

    remote package cloudera-manager-daemons installed

    Configuring Cloudera Manager Agent...

    BEGIN sudo sed -e 's/\(CMF_AGENT_ARGS=\).*/\1"--host_id i-ae804ad2"/' -i
    /etc/default/cloudera-scm-agent

    END (0)

    BEGIN grep server_host=ip-172-31-39-35.ec2.internal
    /etc/cloudera-scm-agent/config.ini

    END (0)

    scm agent is already configured

    Starting Cloudera Manager Agent...

    BEGIN /sbin/service cloudera-scm-agent status | grep running

    server_host=ip-172-31-39-35.ec2.internal

    END (1)

    BEGIN sudo /sbin/service cloudera-scm-agent start

    Starting cloudera-scm-agent: ILEgent logs:

    BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out
    sed 's/^/>>/'
    /usr/lib64/cmf/agent/src/cmf/parcel.py:15: DeprecationWarning: the sets
    module is deprecated
    from sets import Set
    /usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha
    module is deprecated; use the hashlib module instead
    import sha
    [04/Dec/2013 20:15:47 +0000] 9476 MainThread agent INFO SCM Agent
    Version: 4.8.0
    [04/Dec/2013 20:15:47 +0000] 9476 MainThread agent ERROR Could not
    determine hostname or ip address; proceeding.
    Traceback (most recent call last):
    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1600, in
    parse_arguments
    ip_address = socket.gethostbyname(fqdn)
    gaierror: [Errno -2] Name or service not known
    usage: agent.py [-h] [--agent_dir AGENT_DIR]
    [--agent_httpd_port AGENT_HTTPD_PORT] --package_dir
    PACKAGE_DIR [--parcel_dir PARCEL_DIR]
    [--supervisord_path SUPERVISORD_PATH]
    [--supervisord_httpd_port SUPERVISORD_HTTPD_PORT]
    [--standalone STANDALONE] [--master MASTER]
    [--environment ENVIRONMENT] [--host_id HOST_ID]
    [--disable_supervisord_events] --hostname HOSTNAME
    --ip_address IP_ADDRESS [--use_tls]
    [--client_key_file CLIENT_KEY_FILE]
    [--client_cert_file CLIENT_CERT_FILE]
    [--verify_cert_file VERIFY_CERT_FILE]
    [--client_keypw_file CLIENT_KEYPW_FILE] [--logfile LOGFILE]
    [--logdir LOGDIR] [--optional_token] [--clear_agent_dir]
    agent.py: error: argument --hostname is required
    [04/Dec/2013 20:15:47 +0000] 9476 Dummy-1 agent INFO Stopping agent...
    /usr/lib64/cmf/agent/src/cmf/parcel.py:15: DeprecationWarning: the sets
    module is deprecated
    from sets import Set
    /usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha
    module is deprecated; use the hashlib module instead
    import sha
    [04/Dec/2013 20:15:47 +0000] 9476 MainThread agent INFO SCM Agent
    Version: 4.8.0
    [04/Dec/2013 20:15:47 +0000] 9476 MainThread agent ERROR Could not
    determine hostname or ip address; proceeding.
    Traceback (most recent call last):
    File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1600, in
    parse_arguments
    ip_address = socket.gethostbyname(fqdn)
    gaierror: [Errno -2] Name or service not known
    usage: agent.py [-h] [--agent_dir AGENT_DIR]
    [--agent_httpd_port AGENT_HTTPD_PORT] --package_dir
    PACKAGE_DIR [--parcel_dir PARCEL_DIR]
    [--supervisord_path SUPERVISORD_PATH]
    [--supervisord_httpd_port SUPERVISORD_HTTPD_PORT]
    [--standalone STANDALONE] [--master MASTER]
    [--environment ENVIRONMENT] [--host_id HOST_ID]
    [--disable_supervisord_events] --hostname HOSTNAME
    --ip_address IP_ADDRESS [--use_tls]
    [--client_key_file CLIENT_KEY_FILE]
    [--client_cert_file CLIENT_CERT_FILE]
    [--verify_cert_file VERIFY_CERT_FILE]
    [--client_keypw_file CLIENT_KEYPW_FILE] [--logfile LOGFILE]
    [--logdir LOGDIR] [--optional_token] [--clear_agent_dir]
    agent.py: error: argument --hostname is required
    [04/Dec/2013 20:15:47 +0000] 9476 Dummy-1 agent INFO Stopping agent...
    END (0)

    BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log
    sed 's/^/>>/'
    tail: tail: cannot open
    `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for readingcannot
    open `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for reading: No
    such file or directory: No such file or directory


    END (0)

    end of agent logs.

    scm agent could not be started, giving up

    waiting for rollback request

    Close

    Back 1 2 3 4 5 Continue


    To unsubscribe from this group and stop receiving emails from it, send
    an email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedDec 5, '13 at 1:32a
activeDec 9, '13 at 11:18p
posts3
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Sean T Shen: 2 posts Philip Zeyliger: 1 post

People

Translate

site design / logo © 2022 Grokbase