FAQ
Hi,

I'm using cloudera manager to distribute some parcels and (for a couple of
hosts) I get the following error message:

Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown : One or
more hosts did not report their OS Distribution. This is likely due to
running an outdated version of the Cloudera Manager Agent. Please run the
Host Inspector to check the Agent versions..

And, indeed, on those hosts the cloudera manager status page doesn't report
any distribution. I've tried running the host inspector multiple times,
without any success.

Is there a way to set manually the host's distribution? If not, what should
be the course of action when the host's distribution is unknown?

Thanks,
Stefano.

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Search Discussions

  • Herman Chen at Oct 28, 2013 at 10:45 pm
    Hi Stefano

    To address the issue, you can either re-run the host upgrade wizard
    (Hosts->Re-run Host Upgrade Wizard), or manually update the agent
    package on those hosts with outdated agents.

    What error did you run into with host inspector? It'd be helpful if
    you attach the CM server log.

    Herman
    On Mon, Oct 28, 2013 at 3:36 PM, Stefano Guidolin wrote:
    Hi,

    I'm using cloudera manager to distribute some parcels and (for a couple of
    hosts) I get the following error message:

    Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown : One or
    more hosts did not report their OS Distribution. This is likely due to
    running an outdated version of the Cloudera Manager Agent. Please run the
    Host Inspector to check the Agent versions..

    And, indeed, on those hosts the cloudera manager status page doesn't report
    any distribution. I've tried running the host inspector multiple times,
    without any success.

    Is there a way to set manually the host's distribution? If not, what should
    be the course of action when the host's distribution is unknown?

    Thanks,
    Stefano.

    To unsubscribe from this group and stop receiving emails from it, send an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Stefano at Oct 28, 2013 at 11:16 pm
    Hi Herman,

    are you suggesting the agent on those hosts are outdated? I've just checked
    and they are running the same version running on my other machines, which
    is the same as the manager's.

    Here's the host inspector stderr:

    + date
    + date
    Mon Oct 28 22:16:20 UTC 2013
    + umask 027
    + BASE_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC '
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file='
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true'
    + MGMT_HOME_ARG_NAME=--mgmt-home
    ++ dirname /usr/lib64/cmf/service/mgmt/mgmt.sh
    + cloudera_config=/usr/lib64/cmf/service/mgmt
    ++ cd /usr/lib64/cmf/service/mgmt/../common
    ++ pwd
    + cloudera_config=/usr/lib64/cmf/service/common
    + . /usr/lib64/cmf/service/common/cloudera-config.sh
    ++ set -x
    + locate_java_home
    + '[' -z /usr/lib/jvm/java ']'
    + source_parcel_environment
    + '[' '!' -z '' ']'
    + '[' /usr/lib/jvm/java '!=' '' ']'
    + JAVA=/usr/lib/jvm/java/bin/java
    + [[ -n /usr/share/cmf ]]
    + MGMT_CLASSPATH='/usr/share/cmf/lib/*'
    + [[ -z /usr/share/cmf/lib/* ]]
    + JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
    + MGMT_CLASSPATH='/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + DDL_DIR=/usr/share/cmf/schema
    + [[ inspector == \f\i\r\e\h\o\s\e ]]
    + [[ inspector == \e\v\e\n\t\s\e\r\v\e\r ]]
    + [[ inspector == \a\l\e\r\t\p\u\b\l\i\s\h\e\r ]]
    + [[ inspector == \h\e\a\d\l\a\m\p ]]
    + [[ inspector == \i\n\s\p\e\c\t\o\r ]]
    + shift
    ++ pwd
    + MGMT_CLASSPATH='/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + echo 'Executing: ' /usr/lib/jvm/java/bin/java -server
    -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC
    -Dmgmt.log.file= -Djava.awt.headless=true
    -Djava.net.preferIPv4Stack=true -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    + exec /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT


    and here's the stdout:

    Mon Oct 28 22:16:20 UTC 2013
    Executing: /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    /var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.HostDnsInspection@a13f991
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.TimeInspection@77d2b01b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.AllHostsDnsInspection@2927fa12
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.LocalhostSanityInspection@d0721b0
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.UsersAndGroupsInspection@4f34b07e
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.KnownBadKernelInspection@f06fc94
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.EtcHostsInspection@7c6572b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.VersionInspection@2802bd3a
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.ExtantInitdInspection@4bd53f5b
    [ main] ExtantInitdInspection INFO
    Could not list directory /etc/init.d/rc2.d
    [ main] ExtantInitdInspection INFO
    Could not list directory /etc/init.d/rc3.d
    [ main] ExtantInitdInspection INFO
    Could not list directory /etc/init.d/rc4.d
    [ main] ExtantInitdInspection INFO
    Could not list directory /etc/init.d/rc5.d
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.TransparentHugePagesInspection@1d329642
    {
       "allHostDnsErrors" : [ ],
       "allHostDnsSuccesses" : [ 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15,
    17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34,
    35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 44, 51, 49, 48, 55,
    54, 53, 52, 59, 58, 57, 56, 63, 62, 61, 60, 68, 69, 70, 71, 64, 65,
    66, 67, 76, 77, 78, 79, 72, 73, 74, 75, 85, 87, 86, 80, 83, 82, 95,
    89, 88, 91, 90, 100, 101, 98, 99, 96, 97, 111, 109, 118, 117, 115,
    114, 113, 112, 123, 122 ],
       "etcHostsError" : null,
       "etcHostsMessages" : [ ],
       "etcKrbConfMessages" : [ ],
       "extantInitdErrors" : [ ],
       "groupData" : "zookeeper:x:217:\ncloudera-scm:x:215:\nhadoop:x:1030:\n",
       "hostDnsErrors" : [ ],
       "hostname" : "prod1.xxx.com",
       "jceStrength" : 0,
       "kernelVersion" : "3.2.12-3.2.4.amzn1.x86_64",
       "kernelVersionException" : null,
       "localHostIpError" : null,
       "localhostIp" : "127.0.0.1",
       "nowMillis" : 1382998582282,
       "rhelRelease" : null,
       "runExceptions" : [ ],
       "timeZone" : "UTC+00:00",
       "transparentHugePagesDefrag" : null,
       "transparentHugePagesEnabled" : null,
       "transparentHugePagesException" : null,
       "userData" : "hdfs:x:1030:1030:hdfs@xxx.com:/home/hdfs:/bin/bash\nmapred:x:1031:1030:mapred@xxx.com:/home/mapred:/bin/bash\nzookeeper:x:217:217:ZooKeeper:/var/run/zookeeper:/sbin/nologin\noozie:x:1032:1030:oozie@xxx.com:/home/oozie:/bin/bash\ncloudera-scm:x:215:215:Cloudera
    Manager:/var/run/cloudera-scm-server:/sbin/nologin\n"
    }


    Thanks,
    Stefano.




    On 28 October 2013 18:44, Herman Chen wrote:

    Hi Stefano

    To address the issue, you can either re-run the host upgrade wizard
    (Hosts->Re-run Host Upgrade Wizard), or manually update the agent
    package on those hosts with outdated agents.

    What error did you run into with host inspector? It'd be helpful if
    you attach the CM server log.

    Herman
    On Mon, Oct 28, 2013 at 3:36 PM, Stefano Guidolin wrote:
    Hi,

    I'm using cloudera manager to distribute some parcels and (for a couple of
    hosts) I get the following error message:

    Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown : One or
    more hosts did not report their OS Distribution. This is likely due to
    running an outdated version of the Cloudera Manager Agent. Please run the
    Host Inspector to check the Agent versions..

    And, indeed, on those hosts the cloudera manager status page doesn't report
    any distribution. I've tried running the host inspector multiple times,
    without any success.

    Is there a way to set manually the host's distribution? If not, what should
    be the course of action when the host's distribution is unknown?

    Thanks,
    Stefano.

    To unsubscribe from this group and stop receiving emails from it, send an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Herman Chen at Oct 28, 2013 at 11:30 pm
    Hi Stefano

    Yes, agents running code from older version is normally why you'd see
    that error. Did you restart the agents after updating the packages?
    Did you update them manually or use the Host Upgrade Wizard? And what
    version of CM did you upgrade from, and to?

    Herman
    On Mon, Oct 28, 2013 at 4:16 PM, Stefano wrote:
    Hi Herman,

    are you suggesting the agent on those hosts are outdated? I've just checked
    and they are running the same version running on my other machines, which is
    the same as the manager's.

    Here's the host inspector stderr:

    + date
    + date
    Mon Oct 28 22:16:20 UTC 2013
    + umask 027
    + BASE_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC '
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file='
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true'
    + MGMT_HOME_ARG_NAME=--mgmt-home
    ++ dirname /usr/lib64/cmf/service/mgmt/mgmt.sh
    + cloudera_config=/usr/lib64/cmf/service/mgmt
    ++ cd /usr/lib64/cmf/service/mgmt/../common
    ++ pwd
    + cloudera_config=/usr/lib64/cmf/service/common
    + . /usr/lib64/cmf/service/common/cloudera-config.sh
    ++ set -x
    + locate_java_home
    + '[' -z /usr/lib/jvm/java ']'
    + source_parcel_environment
    + '[' '!' -z '' ']'
    + '[' /usr/lib/jvm/java '!=' '' ']'
    + JAVA=/usr/lib/jvm/java/bin/java
    + [[ -n /usr/share/cmf ]]
    + MGMT_CLASSPATH='/usr/share/cmf/lib/*'
    + [[ -z /usr/share/cmf/lib/* ]]
    +
    JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
    +
    MGMT_CLASSPATH='/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + DDL_DIR=/usr/share/cmf/schema
    + [[ inspector == \f\i\r\e\h\o\s\e ]]
    + [[ inspector == \e\v\e\n\t\s\e\r\v\e\r ]]
    + [[ inspector == \a\l\e\r\t\p\u\b\l\i\s\h\e\r ]]
    + [[ inspector == \h\e\a\d\l\a\m\p ]]
    + [[ inspector == \i\n\s\p\e\c\t\o\r ]]
    + shift
    ++ pwd
    +
    MGMT_CLASSPATH='/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + echo 'Executing: ' /usr/lib/jvm/java/bin/java -server
    -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC
    -Dmgmt.log.file= -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true
    -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    + exec /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT


    and here's the stdout:

    Mon Oct 28 22:16:20 UTC 2013
    Executing: /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    /var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.HostDnsInspection@a13f991
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.TimeInspection@77d2b01b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.AllHostsDnsInspection@2927fa12
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.LocalhostSanityInspection@d0721b0
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.UsersAndGroupsInspection@4f34b07e
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.KnownBadKernelInspection@f06fc94
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.EtcHostsInspection@7c6572b
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.VersionInspection@2802bd3a
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.ExtantInitdInspection@4bd53f5b
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc2.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc3.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc4.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc5.d
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.TransparentHugePagesInspection@1d329642
    {
    "allHostDnsErrors" : [ ],
    "allHostDnsSuccesses" : [ 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17,
    16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33,
    38, 39, 36, 37, 42, 43, 40, 41, 46, 44, 51, 49, 48, 55, 54, 53, 52, 59, 58,
    57, 56, 63, 62, 61, 60, 68, 69, 70, 71, 64, 65, 66, 67, 76, 77, 78, 79, 72,
    73, 74, 75, 85, 87, 86, 80, 83, 82, 95, 89, 88, 91, 90, 100, 101, 98, 99,
    96, 97, 111, 109, 118, 117, 115, 114, 113, 112, 123, 122 ],
    "etcHostsError" : null,
    "etcHostsMessages" : [ ],
    "etcKrbConfMessages" : [ ],
    "extantInitdErrors" : [ ],
    "groupData" : "zookeeper:x:217:\ncloudera-scm:x:215:\nhadoop:x:1030:\n",
    "hostDnsErrors" : [ ],
    "hostname" : "prod1.xxx.com",
    "jceStrength" : 0,
    "kernelVersion" : "3.2.12-3.2.4.amzn1.x86_64",
    "kernelVersionException" : null,
    "localHostIpError" : null,
    "localhostIp" : "127.0.0.1",
    "nowMillis" : 1382998582282,
    "rhelRelease" : null,
    "runExceptions" : [ ],
    "timeZone" : "UTC+00:00",
    "transparentHugePagesDefrag" : null,
    "transparentHugePagesEnabled" : null,
    "transparentHugePagesException" : null,
    "userData" :
    "hdfs:x:1030:1030:hdfs@xxx.com:/home/hdfs:/bin/bash\nmapred:x:1031:1030:mapred@xxx.com:/home/mapred:/bin/bash\nzookeeper:x:217:217:ZooKeeper:/var/run/zookeeper:/sbin/nologin\noozie:x:1032:1030:oozie@xxx.com:/home/oozie:/bin/bash\ncloudera-scm:x:215:215:Cloudera
    Manager:/var/run/cloudera-scm-server:/sbin/nologin\n"

    }


    Thanks,
    Stefano.




    On 28 October 2013 18:44, Herman Chen wrote:

    Hi Stefano

    To address the issue, you can either re-run the host upgrade wizard
    (Hosts->Re-run Host Upgrade Wizard), or manually update the agent
    package on those hosts with outdated agents.

    What error did you run into with host inspector? It'd be helpful if
    you attach the CM server log.

    Herman

    On Mon, Oct 28, 2013 at 3:36 PM, Stefano Guidolin <st.guido@gmail.com>
    wrote:
    Hi,

    I'm using cloudera manager to distribute some parcels and (for a couple
    of
    hosts) I get the following error message:

    Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown : One
    or
    more hosts did not report their OS Distribution. This is likely due to
    running an outdated version of the Cloudera Manager Agent. Please run
    the
    Host Inspector to check the Agent versions..

    And, indeed, on those hosts the cloudera manager status page doesn't
    report
    any distribution. I've tried running the host inspector multiple times,
    without any success.

    Is there a way to set manually the host's distribution? If not, what
    should
    be the course of action when the host's distribution is unknown?

    Thanks,
    Stefano.

    To unsubscribe from this group and stop receiving emails from it, send
    an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Stefano at Oct 29, 2013 at 12:05 am
    I've updated them manually and have tried to restart them already cause I
    think I saw that advice in a previous discussion here.

    We are currently running version 4.7.2 and I'm not sure what was the
    previous version (but I can check). Also, those machines were not part of a
    version upgrade, I'm simply trying to add them to the cluster and install
    some parcels. I've done that successfully for some other machines, but it's
    failing on those specific machines.

    S.

    On 28 October 2013 19:30, Herman Chen wrote:

    Hi Stefano

    Yes, agents running code from older version is normally why you'd see
    that error. Did you restart the agents after updating the packages?
    Did you update them manually or use the Host Upgrade Wizard? And what
    version of CM did you upgrade from, and to?

    Herman
    On Mon, Oct 28, 2013 at 4:16 PM, Stefano wrote:
    Hi Herman,

    are you suggesting the agent on those hosts are outdated? I've just checked
    and they are running the same version running on my other machines, which is
    the same as the manager's.

    Here's the host inspector stderr:

    + date
    + date
    Mon Oct 28 22:16:20 UTC 2013
    + umask 027
    + BASE_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC '
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file='
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true'
    + MGMT_HOME_ARG_NAME=--mgmt-home
    ++ dirname /usr/lib64/cmf/service/mgmt/mgmt.sh
    + cloudera_config=/usr/lib64/cmf/service/mgmt
    ++ cd /usr/lib64/cmf/service/mgmt/../common
    ++ pwd
    + cloudera_config=/usr/lib64/cmf/service/common
    + . /usr/lib64/cmf/service/common/cloudera-config.sh
    ++ set -x
    + locate_java_home
    + '[' -z /usr/lib/jvm/java ']'
    + source_parcel_environment
    + '[' '!' -z '' ']'
    + '[' /usr/lib/jvm/java '!=' '' ']'
    + JAVA=/usr/lib/jvm/java/bin/java
    + [[ -n /usr/share/cmf ]]
    + MGMT_CLASSPATH='/usr/share/cmf/lib/*'
    + [[ -z /usr/share/cmf/lib/* ]]
    +
    JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
    +
    MGMT_CLASSPATH='/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + DDL_DIR=/usr/share/cmf/schema
    + [[ inspector == \f\i\r\e\h\o\s\e ]]
    + [[ inspector == \e\v\e\n\t\s\e\r\v\e\r ]]
    + [[ inspector == \a\l\e\r\t\p\u\b\l\i\s\h\e\r ]]
    + [[ inspector == \h\e\a\d\l\a\m\p ]]
    + [[ inspector == \i\n\s\p\e\c\t\o\r ]]
    + shift
    ++ pwd
    +
    MGMT_CLASSPATH='/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + echo 'Executing: ' /usr/lib/jvm/java/bin/java -server
    -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC
    -Dmgmt.log.file= -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true
    -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    + exec /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT


    and here's the stdout:

    Mon Oct 28 22:16:20 UTC 2013
    Executing: /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    /var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.HostDnsInspection@a13f991
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.TimeInspection@77d2b01b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.AllHostsDnsInspection@2927fa12
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.LocalhostSanityInspection@d0721b0
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.UsersAndGroupsInspection@4f34b07e
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.KnownBadKernelInspection@f06fc94
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.EtcHostsInspection@7c6572b
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.VersionInspection@2802bd3a
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.ExtantInitdInspection@4bd53f5b
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc2.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc3.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc4.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc5.d
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.TransparentHugePagesInspection@1d329642
    {
    "allHostDnsErrors" : [ ],
    "allHostDnsSuccesses" : [ 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17,
    16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33,
    38, 39, 36, 37, 42, 43, 40, 41, 46, 44, 51, 49, 48, 55, 54, 53, 52, 59, 58,
    57, 56, 63, 62, 61, 60, 68, 69, 70, 71, 64, 65, 66, 67, 76, 77, 78, 79, 72,
    73, 74, 75, 85, 87, 86, 80, 83, 82, 95, 89, 88, 91, 90, 100, 101, 98, 99,
    96, 97, 111, 109, 118, 117, 115, 114, 113, 112, 123, 122 ],
    "etcHostsError" : null,
    "etcHostsMessages" : [ ],
    "etcKrbConfMessages" : [ ],
    "extantInitdErrors" : [ ],
    "groupData" :
    "zookeeper:x:217:\ncloudera-scm:x:215:\nhadoop:x:1030:\n",
    "hostDnsErrors" : [ ],
    "hostname" : "prod1.xxx.com",
    "jceStrength" : 0,
    "kernelVersion" : "3.2.12-3.2.4.amzn1.x86_64",
    "kernelVersionException" : null,
    "localHostIpError" : null,
    "localhostIp" : "127.0.0.1",
    "nowMillis" : 1382998582282,
    "rhelRelease" : null,
    "runExceptions" : [ ],
    "timeZone" : "UTC+00:00",
    "transparentHugePagesDefrag" : null,
    "transparentHugePagesEnabled" : null,
    "transparentHugePagesException" : null,
    "userData" :
    "hdfs:x:1030:1030:hdfs@xxx.com:
    /home/hdfs:/bin/bash\nmapred:x:1031:1030:mapred@xxx.com:
    /home/mapred:/bin/bash\nzookeeper:x:217:217:ZooKeeper:/var/run/zookeeper:/sbin/nologin\noozie:x:1032:1030:oozie@xxx.com:
    /home/oozie:/bin/bash\ncloudera-scm:x:215:215:Cloudera
    Manager:/var/run/cloudera-scm-server:/sbin/nologin\n"

    }


    Thanks,
    Stefano.




    On 28 October 2013 18:44, Herman Chen wrote:

    Hi Stefano

    To address the issue, you can either re-run the host upgrade wizard
    (Hosts->Re-run Host Upgrade Wizard), or manually update the agent
    package on those hosts with outdated agents.

    What error did you run into with host inspector? It'd be helpful if
    you attach the CM server log.

    Herman

    On Mon, Oct 28, 2013 at 3:36 PM, Stefano Guidolin <st.guido@gmail.com>
    wrote:
    Hi,

    I'm using cloudera manager to distribute some parcels and (for a
    couple
    of
    hosts) I get the following error message:

    Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown :
    One
    or
    more hosts did not report their OS Distribution. This is likely due to
    running an outdated version of the Cloudera Manager Agent. Please run
    the
    Host Inspector to check the Agent versions..

    And, indeed, on those hosts the cloudera manager status page doesn't
    report
    any distribution. I've tried running the host inspector multiple
    times,
    without any success.

    Is there a way to set manually the host's distribution? If not, what
    should
    be the course of action when the host's distribution is unknown?

    Thanks,
    Stefano.

    To unsubscribe from this group and stop receiving emails from it, send
    an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Vikas Singh at Oct 29, 2013 at 12:29 am
    Hi Stefano,

    Can you please log on to these hosts and run "ps -aef | grep agent.py". If
    you see multiple of these processes running, can you please kill them (kill
    -9 <pid>) and then start agent again (service cloduera-scm-agent start).
    Multiple agents running may cause issue. Can you also (re)confirm the
    version of agent you have on these hosts? You can find it in
    "/var/log/cloudera-scm-agent/cloudera-scm-agent.out" file.

    Vikas

    On Mon, Oct 28, 2013 at 5:05 PM, Stefano wrote:

    I've updated them manually and have tried to restart them already cause I
    think I saw that advice in a previous discussion here.

    We are currently running version 4.7.2 and I'm not sure what was the
    previous version (but I can check). Also, those machines were not part of a
    version upgrade, I'm simply trying to add them to the cluster and install
    some parcels. I've done that successfully for some other machines, but it's
    failing on those specific machines.

    S.

    On 28 October 2013 19:30, Herman Chen wrote:

    Hi Stefano

    Yes, agents running code from older version is normally why you'd see
    that error. Did you restart the agents after updating the packages?
    Did you update them manually or use the Host Upgrade Wizard? And what
    version of CM did you upgrade from, and to?

    Herman
    On Mon, Oct 28, 2013 at 4:16 PM, Stefano wrote:
    Hi Herman,

    are you suggesting the agent on those hosts are outdated? I've just checked
    and they are running the same version running on my other machines, which is
    the same as the manager's.

    Here's the host inspector stderr:

    + date
    + date
    Mon Oct 28 22:16:20 UTC 2013
    + umask 027
    + BASE_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC '
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file='
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true'
    + MGMT_HOME_ARG_NAME=--mgmt-home
    ++ dirname /usr/lib64/cmf/service/mgmt/mgmt.sh
    + cloudera_config=/usr/lib64/cmf/service/mgmt
    ++ cd /usr/lib64/cmf/service/mgmt/../common
    ++ pwd
    + cloudera_config=/usr/lib64/cmf/service/common
    + . /usr/lib64/cmf/service/common/cloudera-config.sh
    ++ set -x
    + locate_java_home
    + '[' -z /usr/lib/jvm/java ']'
    + source_parcel_environment
    + '[' '!' -z '' ']'
    + '[' /usr/lib/jvm/java '!=' '' ']'
    + JAVA=/usr/lib/jvm/java/bin/java
    + [[ -n /usr/share/cmf ]]
    + MGMT_CLASSPATH='/usr/share/cmf/lib/*'
    + [[ -z /usr/share/cmf/lib/* ]]
    +
    JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
    +
    MGMT_CLASSPATH='/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + DDL_DIR=/usr/share/cmf/schema
    + [[ inspector == \f\i\r\e\h\o\s\e ]]
    + [[ inspector == \e\v\e\n\t\s\e\r\v\e\r ]]
    + [[ inspector == \a\l\e\r\t\p\u\b\l\i\s\h\e\r ]]
    + [[ inspector == \h\e\a\d\l\a\m\p ]]
    + [[ inspector == \i\n\s\p\e\c\t\o\r ]]
    + shift
    ++ pwd
    +
    MGMT_CLASSPATH='/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + echo 'Executing: ' /usr/lib/jvm/java/bin/java -server
    -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC
    -Dmgmt.log.file= -Djava.awt.headless=true
    -Djava.net.preferIPv4Stack=true
    -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    + exec /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT


    and here's the stdout:

    Mon Oct 28 22:16:20 UTC 2013
    Executing: /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    /var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.HostDnsInspection@a13f991
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.TimeInspection@77d2b01b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.AllHostsDnsInspection@2927fa12
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.LocalhostSanityInspection@d0721b0
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.UsersAndGroupsInspection@4f34b07e
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.KnownBadKernelInspection@f06fc94
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.EtcHostsInspection@7c6572b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.VersionInspection@2802bd3a
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.ExtantInitdInspection@4bd53f5b
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc2.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc3.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc4.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc5.d
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.TransparentHugePagesInspection@1d329642
    {
    "allHostDnsErrors" : [ ],
    "allHostDnsSuccesses" : [ 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17,
    16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33,
    38, 39, 36, 37, 42, 43, 40, 41, 46, 44, 51, 49, 48, 55, 54, 53, 52, 59, 58,
    57, 56, 63, 62, 61, 60, 68, 69, 70, 71, 64, 65, 66, 67, 76, 77, 78, 79, 72,
    73, 74, 75, 85, 87, 86, 80, 83, 82, 95, 89, 88, 91, 90, 100, 101, 98, 99,
    96, 97, 111, 109, 118, 117, 115, 114, 113, 112, 123, 122 ],
    "etcHostsError" : null,
    "etcHostsMessages" : [ ],
    "etcKrbConfMessages" : [ ],
    "extantInitdErrors" : [ ],
    "groupData" :
    "zookeeper:x:217:\ncloudera-scm:x:215:\nhadoop:x:1030:\n",
    "hostDnsErrors" : [ ],
    "hostname" : "prod1.xxx.com",
    "jceStrength" : 0,
    "kernelVersion" : "3.2.12-3.2.4.amzn1.x86_64",
    "kernelVersionException" : null,
    "localHostIpError" : null,
    "localhostIp" : "127.0.0.1",
    "nowMillis" : 1382998582282,
    "rhelRelease" : null,
    "runExceptions" : [ ],
    "timeZone" : "UTC+00:00",
    "transparentHugePagesDefrag" : null,
    "transparentHugePagesEnabled" : null,
    "transparentHugePagesException" : null,
    "userData" :
    "hdfs:x:1030:1030:hdfs@xxx.com:
    /home/hdfs:/bin/bash\nmapred:x:1031:1030:mapred@xxx.com:
    /home/mapred:/bin/bash\nzookeeper:x:217:217:ZooKeeper:/var/run/zookeeper:/sbin/nologin\noozie:x:1032:1030:oozie@xxx.com:
    /home/oozie:/bin/bash\ncloudera-scm:x:215:215:Cloudera
    Manager:/var/run/cloudera-scm-server:/sbin/nologin\n"

    }


    Thanks,
    Stefano.




    On 28 October 2013 18:44, Herman Chen wrote:

    Hi Stefano

    To address the issue, you can either re-run the host upgrade wizard
    (Hosts->Re-run Host Upgrade Wizard), or manually update the agent
    package on those hosts with outdated agents.

    What error did you run into with host inspector? It'd be helpful if
    you attach the CM server log.

    Herman

    On Mon, Oct 28, 2013 at 3:36 PM, Stefano Guidolin <st.guido@gmail.com>
    wrote:
    Hi,

    I'm using cloudera manager to distribute some parcels and (for a
    couple
    of
    hosts) I get the following error message:

    Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown :
    One
    or
    more hosts did not report their OS Distribution. This is likely due
    to
    running an outdated version of the Cloudera Manager Agent. Please run
    the
    Host Inspector to check the Agent versions..

    And, indeed, on those hosts the cloudera manager status page doesn't
    report
    any distribution. I've tried running the host inspector multiple
    times,
    without any success.

    Is there a way to set manually the host's distribution? If not, what
    should
    be the course of action when the host's distribution is unknown?

    Thanks,
    Stefano.

    To unsubscribe from this group and stop receiving emails from it,
    send
    an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Stefano at Oct 29, 2013 at 2:43 pm
    Hi Vikas,

    I've just checked and there's only 1 process running the agent on those
    hosts. Also the version, as per cloudera-scm-agent.out is:

    [23/Oct/2013 17:29:09 +0000] 842 MainThread agent INFO SCM Agent
    Version: 4.7.2

    Is there any way to manually force the distro config on those hosts? I
    think that would solve my problem.

    Thanks,

    Stefano.



    On 28 October 2013 20:29, Vikas Singh wrote:

    Hi Stefano,

    Can you please log on to these hosts and run "ps -aef | grep agent.py".
    If you see multiple of these processes running, can you please kill them
    (kill -9 <pid>) and then start agent again (service cloduera-scm-agent
    start). Multiple agents running may cause issue. Can you also (re)confirm
    the version of agent you have on these hosts? You can find it in
    "/var/log/cloudera-scm-agent/cloudera-scm-agent.out" file.

    Vikas

    On Mon, Oct 28, 2013 at 5:05 PM, Stefano wrote:

    I've updated them manually and have tried to restart them already cause I
    think I saw that advice in a previous discussion here.

    We are currently running version 4.7.2 and I'm not sure what was the
    previous version (but I can check). Also, those machines were not part of a
    version upgrade, I'm simply trying to add them to the cluster and install
    some parcels. I've done that successfully for some other machines, but it's
    failing on those specific machines.

    S.

    On 28 October 2013 19:30, Herman Chen wrote:

    Hi Stefano

    Yes, agents running code from older version is normally why you'd see
    that error. Did you restart the agents after updating the packages?
    Did you update them manually or use the Host Upgrade Wizard? And what
    version of CM did you upgrade from, and to?

    Herman
    On Mon, Oct 28, 2013 at 4:16 PM, Stefano wrote:
    Hi Herman,

    are you suggesting the agent on those hosts are outdated? I've just checked
    and they are running the same version running on my other machines, which is
    the same as the manager's.

    Here's the host inspector stderr:

    + date
    + date
    Mon Oct 28 22:16:20 UTC 2013
    + umask 027
    + BASE_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC '
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file='
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true'
    + MGMT_HOME_ARG_NAME=--mgmt-home
    ++ dirname /usr/lib64/cmf/service/mgmt/mgmt.sh
    + cloudera_config=/usr/lib64/cmf/service/mgmt
    ++ cd /usr/lib64/cmf/service/mgmt/../common
    ++ pwd
    + cloudera_config=/usr/lib64/cmf/service/common
    + . /usr/lib64/cmf/service/common/cloudera-config.sh
    ++ set -x
    + locate_java_home
    + '[' -z /usr/lib/jvm/java ']'
    + source_parcel_environment
    + '[' '!' -z '' ']'
    + '[' /usr/lib/jvm/java '!=' '' ']'
    + JAVA=/usr/lib/jvm/java/bin/java
    + [[ -n /usr/share/cmf ]]
    + MGMT_CLASSPATH='/usr/share/cmf/lib/*'
    + [[ -z /usr/share/cmf/lib/* ]]
    +
    JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
    +
    MGMT_CLASSPATH='/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + DDL_DIR=/usr/share/cmf/schema
    + [[ inspector == \f\i\r\e\h\o\s\e ]]
    + [[ inspector == \e\v\e\n\t\s\e\r\v\e\r ]]
    + [[ inspector == \a\l\e\r\t\p\u\b\l\i\s\h\e\r ]]
    + [[ inspector == \h\e\a\d\l\a\m\p ]]
    + [[ inspector == \i\n\s\p\e\c\t\o\r ]]
    + shift
    ++ pwd
    +
    MGMT_CLASSPATH='/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + echo 'Executing: ' /usr/lib/jvm/java/bin/java -server
    -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC
    -Dmgmt.log.file= -Djava.awt.headless=true
    -Djava.net.preferIPv4Stack=true
    -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    + exec /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT


    and here's the stdout:

    Mon Oct 28 22:16:20 UTC 2013
    Executing: /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    /var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.HostDnsInspection@a13f991
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.TimeInspection@77d2b01b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.AllHostsDnsInspection@2927fa12
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.LocalhostSanityInspection@d0721b0
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.UsersAndGroupsInspection@4f34b07e
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.KnownBadKernelInspection@f06fc94
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.EtcHostsInspection@7c6572b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.VersionInspection@2802bd3a
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.ExtantInitdInspection@4bd53f5b
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc2.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc3.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc4.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc5.d
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.TransparentHugePagesInspection@1d329642
    {
    "allHostDnsErrors" : [ ],
    "allHostDnsSuccesses" : [ 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17,
    16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33,
    38, 39, 36, 37, 42, 43, 40, 41, 46, 44, 51, 49, 48, 55, 54, 53, 52, 59, 58,
    57, 56, 63, 62, 61, 60, 68, 69, 70, 71, 64, 65, 66, 67, 76, 77, 78, 79, 72,
    73, 74, 75, 85, 87, 86, 80, 83, 82, 95, 89, 88, 91, 90, 100, 101, 98, 99,
    96, 97, 111, 109, 118, 117, 115, 114, 113, 112, 123, 122 ],
    "etcHostsError" : null,
    "etcHostsMessages" : [ ],
    "etcKrbConfMessages" : [ ],
    "extantInitdErrors" : [ ],
    "groupData" :
    "zookeeper:x:217:\ncloudera-scm:x:215:\nhadoop:x:1030:\n",
    "hostDnsErrors" : [ ],
    "hostname" : "prod1.xxx.com",
    "jceStrength" : 0,
    "kernelVersion" : "3.2.12-3.2.4.amzn1.x86_64",
    "kernelVersionException" : null,
    "localHostIpError" : null,
    "localhostIp" : "127.0.0.1",
    "nowMillis" : 1382998582282,
    "rhelRelease" : null,
    "runExceptions" : [ ],
    "timeZone" : "UTC+00:00",
    "transparentHugePagesDefrag" : null,
    "transparentHugePagesEnabled" : null,
    "transparentHugePagesException" : null,
    "userData" :
    "hdfs:x:1030:1030:hdfs@xxx.com:
    /home/hdfs:/bin/bash\nmapred:x:1031:1030:mapred@xxx.com:
    /home/mapred:/bin/bash\nzookeeper:x:217:217:ZooKeeper:/var/run/zookeeper:/sbin/nologin\noozie:x:1032:1030:oozie@xxx.com:
    /home/oozie:/bin/bash\ncloudera-scm:x:215:215:Cloudera
    Manager:/var/run/cloudera-scm-server:/sbin/nologin\n"

    }


    Thanks,
    Stefano.




    On 28 October 2013 18:44, Herman Chen wrote:

    Hi Stefano

    To address the issue, you can either re-run the host upgrade wizard
    (Hosts->Re-run Host Upgrade Wizard), or manually update the agent
    package on those hosts with outdated agents.

    What error did you run into with host inspector? It'd be helpful if
    you attach the CM server log.

    Herman

    On Mon, Oct 28, 2013 at 3:36 PM, Stefano Guidolin <st.guido@gmail.com
    wrote:
    Hi,

    I'm using cloudera manager to distribute some parcels and (for a
    couple
    of
    hosts) I get the following error message:

    Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown :
    One
    or
    more hosts did not report their OS Distribution. This is likely due
    to
    running an outdated version of the Cloudera Manager Agent. Please
    run
    the
    Host Inspector to check the Agent versions..

    And, indeed, on those hosts the cloudera manager status page doesn't
    report
    any distribution. I've tried running the host inspector multiple
    times,
    without any success.

    Is there a way to set manually the host's distribution? If not, what
    should
    be the course of action when the host's distribution is unknown?

    Thanks,
    Stefano.

    To unsubscribe from this group and stop receiving emails from it,
    send
    an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send
    an email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Vikas Singh at Oct 29, 2013 at 5:38 pm
    Hi Stefano,

    I don't know a way to force the distro. The agent reads the distro and
    communicates it back to CM server. What does following command return on
    these hosts:

    python -c "import platform; print platform.dist()"

    Also, can you look into Agent log file
    "/var/log/cloduera-scm-agent/cloudera-scm-agent.log" to check if there is
    any error reported there? Look into CM server log too
    (/var/log/cloudera-scm-server/cloduera-scm-server.log). If you don't see
    anything obvious, can you please attach these logs to this mail thread.
    That will give us more info on what is going on.

    Thanks,
    Vikas



    On Tue, Oct 29, 2013 at 7:43 AM, Stefano wrote:

    Hi Vikas,

    I've just checked and there's only 1 process running the agent on those
    hosts. Also the version, as per cloudera-scm-agent.out is:

    [23/Oct/2013 17:29:09 +0000] 842 MainThread agent INFO SCM
    Agent Version: 4.7.2

    Is there any way to manually force the distro config on those hosts? I
    think that would solve my problem.

    Thanks,

    Stefano.



    On 28 October 2013 20:29, Vikas Singh wrote:

    Hi Stefano,

    Can you please log on to these hosts and run "ps -aef | grep agent.py".
    If you see multiple of these processes running, can you please kill them
    (kill -9 <pid>) and then start agent again (service cloduera-scm-agent
    start). Multiple agents running may cause issue. Can you also (re)confirm
    the version of agent you have on these hosts? You can find it in
    "/var/log/cloudera-scm-agent/cloudera-scm-agent.out" file.

    Vikas

    On Mon, Oct 28, 2013 at 5:05 PM, Stefano wrote:

    I've updated them manually and have tried to restart them already cause
    I think I saw that advice in a previous discussion here.

    We are currently running version 4.7.2 and I'm not sure what was the
    previous version (but I can check). Also, those machines were not part of a
    version upgrade, I'm simply trying to add them to the cluster and install
    some parcels. I've done that successfully for some other machines, but it's
    failing on those specific machines.

    S.

    On 28 October 2013 19:30, Herman Chen wrote:

    Hi Stefano

    Yes, agents running code from older version is normally why you'd see
    that error. Did you restart the agents after updating the packages?
    Did you update them manually or use the Host Upgrade Wizard? And what
    version of CM did you upgrade from, and to?

    Herman
    On Mon, Oct 28, 2013 at 4:16 PM, Stefano wrote:
    Hi Herman,

    are you suggesting the agent on those hosts are outdated? I've just checked
    and they are running the same version running on my other machines, which is
    the same as the manager's.

    Here's the host inspector stderr:

    + date
    + date
    Mon Oct 28 22:16:20 UTC 2013
    + umask 027
    + BASE_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC '
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file='
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true'
    + MGMT_HOME_ARG_NAME=--mgmt-home
    ++ dirname /usr/lib64/cmf/service/mgmt/mgmt.sh
    + cloudera_config=/usr/lib64/cmf/service/mgmt
    ++ cd /usr/lib64/cmf/service/mgmt/../common
    ++ pwd
    + cloudera_config=/usr/lib64/cmf/service/common
    + . /usr/lib64/cmf/service/common/cloudera-config.sh
    ++ set -x
    + locate_java_home
    + '[' -z /usr/lib/jvm/java ']'
    + source_parcel_environment
    + '[' '!' -z '' ']'
    + '[' /usr/lib/jvm/java '!=' '' ']'
    + JAVA=/usr/lib/jvm/java/bin/java
    + [[ -n /usr/share/cmf ]]
    + MGMT_CLASSPATH='/usr/share/cmf/lib/*'
    + [[ -z /usr/share/cmf/lib/* ]]
    +
    JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
    +
    MGMT_CLASSPATH='/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + DDL_DIR=/usr/share/cmf/schema
    + [[ inspector == \f\i\r\e\h\o\s\e ]]
    + [[ inspector == \e\v\e\n\t\s\e\r\v\e\r ]]
    + [[ inspector == \a\l\e\r\t\p\u\b\l\i\s\h\e\r ]]
    + [[ inspector == \h\e\a\d\l\a\m\p ]]
    + [[ inspector == \i\n\s\p\e\c\t\o\r ]]
    + shift
    ++ pwd
    +
    MGMT_CLASSPATH='/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + echo 'Executing: ' /usr/lib/jvm/java/bin/java -server
    -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC
    -Dmgmt.log.file= -Djava.awt.headless=true
    -Djava.net.preferIPv4Stack=true
    -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    + exec /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT


    and here's the stdout:

    Mon Oct 28 22:16:20 UTC 2013
    Executing: /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    /var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.HostDnsInspection@a13f991
    [ main] Inspector INFO
    Running inspection: com.cloudera.cmf.inspector.TimeInspection@77d2b01b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.AllHostsDnsInspection@2927fa12
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.LocalhostSanityInspection@d0721b0
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.UsersAndGroupsInspection@4f34b07e
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.KnownBadKernelInspection@f06fc94
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.EtcHostsInspection@7c6572b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.VersionInspection@2802bd3a
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.ExtantInitdInspection@4bd53f5b
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc2.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc3.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc4.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc5.d
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.TransparentHugePagesInspection@1d329642
    {
    "allHostDnsErrors" : [ ],
    "allHostDnsSuccesses" : [ 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17,
    16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33,
    38, 39, 36, 37, 42, 43, 40, 41, 46, 44, 51, 49, 48, 55, 54, 53, 52, 59, 58,
    57, 56, 63, 62, 61, 60, 68, 69, 70, 71, 64, 65, 66, 67, 76, 77, 78, 79, 72,
    73, 74, 75, 85, 87, 86, 80, 83, 82, 95, 89, 88, 91, 90, 100, 101, 98, 99,
    96, 97, 111, 109, 118, 117, 115, 114, 113, 112, 123, 122 ],
    "etcHostsError" : null,
    "etcHostsMessages" : [ ],
    "etcKrbConfMessages" : [ ],
    "extantInitdErrors" : [ ],
    "groupData" :
    "zookeeper:x:217:\ncloudera-scm:x:215:\nhadoop:x:1030:\n",
    "hostDnsErrors" : [ ],
    "hostname" : "prod1.xxx.com",
    "jceStrength" : 0,
    "kernelVersion" : "3.2.12-3.2.4.amzn1.x86_64",
    "kernelVersionException" : null,
    "localHostIpError" : null,
    "localhostIp" : "127.0.0.1",
    "nowMillis" : 1382998582282,
    "rhelRelease" : null,
    "runExceptions" : [ ],
    "timeZone" : "UTC+00:00",
    "transparentHugePagesDefrag" : null,
    "transparentHugePagesEnabled" : null,
    "transparentHugePagesException" : null,
    "userData" :
    "hdfs:x:1030:1030:hdfs@xxx.com:
    /home/hdfs:/bin/bash\nmapred:x:1031:1030:mapred@xxx.com:
    /home/mapred:/bin/bash\nzookeeper:x:217:217:ZooKeeper:/var/run/zookeeper:/sbin/nologin\noozie:x:1032:1030:oozie@xxx.com:
    /home/oozie:/bin/bash\ncloudera-scm:x:215:215:Cloudera
    Manager:/var/run/cloudera-scm-server:/sbin/nologin\n"

    }


    Thanks,
    Stefano.




    On 28 October 2013 18:44, Herman Chen wrote:

    Hi Stefano

    To address the issue, you can either re-run the host upgrade wizard
    (Hosts->Re-run Host Upgrade Wizard), or manually update the agent
    package on those hosts with outdated agents.

    What error did you run into with host inspector? It'd be helpful if
    you attach the CM server log.

    Herman

    On Mon, Oct 28, 2013 at 3:36 PM, Stefano Guidolin <
    st.guido@gmail.com>
    wrote:
    Hi,

    I'm using cloudera manager to distribute some parcels and (for a
    couple
    of
    hosts) I get the following error message:

    Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown
    : One
    or
    more hosts did not report their OS Distribution. This is likely
    due to
    running an outdated version of the Cloudera Manager Agent. Please
    run
    the
    Host Inspector to check the Agent versions..

    And, indeed, on those hosts the cloudera manager status page
    doesn't
    report
    any distribution. I've tried running the host inspector multiple
    times,
    without any success.

    Is there a way to set manually the host's distribution? If not,
    what
    should
    be the course of action when the host's distribution is unknown?

    Thanks,
    Stefano.

    To unsubscribe from this group and stop receiving emails from it,
    send
    an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send
    an email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Stefano at Oct 29, 2013 at 9:39 pm
    Hi Vikas,

    thank you for your help, I managed to solve my issue.

    The python command you suggested was returning: ('', '', '')
    Probably something to do with the old Amazon AMI those machines are
    running. By creating the file /etc/centos-release with the right info, I've
    managed to get both the python script and the cloudera agent to recognize
    the distro, and could install the right parcels.

    Stefano.



    On 29 October 2013 13:38, Vikas Singh wrote:

    Hi Stefano,

    I don't know a way to force the distro. The agent reads the distro and
    communicates it back to CM server. What does following command return on
    these hosts:

    python -c "import platform; print platform.dist()"

    Also, can you look into Agent log file
    "/var/log/cloduera-scm-agent/cloudera-scm-agent.log" to check if there is
    any error reported there? Look into CM server log too
    (/var/log/cloudera-scm-server/cloduera-scm-server.log). If you don't see
    anything obvious, can you please attach these logs to this mail thread.
    That will give us more info on what is going on.

    Thanks,
    Vikas



    On Tue, Oct 29, 2013 at 7:43 AM, Stefano wrote:

    Hi Vikas,

    I've just checked and there's only 1 process running the agent on those
    hosts. Also the version, as per cloudera-scm-agent.out is:

    [23/Oct/2013 17:29:09 +0000] 842 MainThread agent INFO SCM
    Agent Version: 4.7.2

    Is there any way to manually force the distro config on those hosts? I
    think that would solve my problem.

    Thanks,

    Stefano.



    On 28 October 2013 20:29, Vikas Singh wrote:

    Hi Stefano,

    Can you please log on to these hosts and run "ps -aef | grep agent.py".
    If you see multiple of these processes running, can you please kill them
    (kill -9 <pid>) and then start agent again (service cloduera-scm-agent
    start). Multiple agents running may cause issue. Can you also (re)confirm
    the version of agent you have on these hosts? You can find it in
    "/var/log/cloudera-scm-agent/cloudera-scm-agent.out" file.

    Vikas

    On Mon, Oct 28, 2013 at 5:05 PM, Stefano wrote:

    I've updated them manually and have tried to restart them already cause
    I think I saw that advice in a previous discussion here.

    We are currently running version 4.7.2 and I'm not sure what was the
    previous version (but I can check). Also, those machines were not part of a
    version upgrade, I'm simply trying to add them to the cluster and install
    some parcels. I've done that successfully for some other machines, but it's
    failing on those specific machines.

    S.

    On 28 October 2013 19:30, Herman Chen wrote:

    Hi Stefano

    Yes, agents running code from older version is normally why you'd see
    that error. Did you restart the agents after updating the packages?
    Did you update them manually or use the Host Upgrade Wizard? And what
    version of CM did you upgrade from, and to?

    Herman
    On Mon, Oct 28, 2013 at 4:16 PM, Stefano wrote:
    Hi Herman,

    are you suggesting the agent on those hosts are outdated? I've just checked
    and they are running the same version running on my other machines, which is
    the same as the manager's.

    Here's the host inspector stderr:

    + date
    + date
    Mon Oct 28 22:16:20 UTC 2013
    + umask 027
    + BASE_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC '
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file='
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true'
    + MGMT_JAVA_OPTS='-server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true'
    + MGMT_HOME_ARG_NAME=--mgmt-home
    ++ dirname /usr/lib64/cmf/service/mgmt/mgmt.sh
    + cloudera_config=/usr/lib64/cmf/service/mgmt
    ++ cd /usr/lib64/cmf/service/mgmt/../common
    ++ pwd
    + cloudera_config=/usr/lib64/cmf/service/common
    + . /usr/lib64/cmf/service/common/cloudera-config.sh
    ++ set -x
    + locate_java_home
    + '[' -z /usr/lib/jvm/java ']'
    + source_parcel_environment
    + '[' '!' -z '' ']'
    + '[' /usr/lib/jvm/java '!=' '' ']'
    + JAVA=/usr/lib/jvm/java/bin/java
    + [[ -n /usr/share/cmf ]]
    + MGMT_CLASSPATH='/usr/share/cmf/lib/*'
    + [[ -z /usr/share/cmf/lib/* ]]
    +
    JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
    +
    MGMT_CLASSPATH='/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + DDL_DIR=/usr/share/cmf/schema
    + [[ inspector == \f\i\r\e\h\o\s\e ]]
    + [[ inspector == \e\v\e\n\t\s\e\r\v\e\r ]]
    + [[ inspector == \a\l\e\r\t\p\u\b\l\i\s\h\e\r ]]
    + [[ inspector == \h\e\a\d\l\a\m\p ]]
    + [[ inspector == \i\n\s\p\e\c\t\o\r ]]
    + shift
    ++ pwd
    +
    MGMT_CLASSPATH='/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    + echo 'Executing: ' /usr/lib/jvm/java/bin/java -server
    -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC
    -Dmgmt.log.file= -Djava.awt.headless=true
    -Djava.net.preferIPv4Stack=true
    -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    + exec /usr/lib/jvm/java/bin/java -server -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    '/var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*'
    com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT


    and here's the stdout:

    Mon Oct 28 22:16:20 UTC 2013
    Executing: /usr/lib/jvm/java/bin/java -server
    -XX:+UseConcMarkSweepGC
    -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=
    -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp
    /var/run/cloudera-scm-agent/process/11657-host-inspector:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/*
    com.cloudera.cmf.Inspector input.json output.json DEFAULT
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.HostDnsInspection@a13f991
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.TimeInspection@77d2b01b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.AllHostsDnsInspection@2927fa12
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.LocalhostSanityInspection@d0721b0
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.UsersAndGroupsInspection@4f34b07e
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.KnownBadKernelInspection@f06fc94
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.EtcHostsInspection@7c6572b
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.VersionInspection@2802bd3a
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.ExtantInitdInspection@4bd53f5b
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc2.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc3.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc4.d
    [ main] ExtantInitdInspection INFO Could
    not list directory /etc/init.d/rc5.d
    [ main] Inspector INFO
    Running inspection:
    com.cloudera.cmf.inspector.TransparentHugePagesInspection@1d329642
    {
    "allHostDnsErrors" : [ ],
    "allHostDnsSuccesses" : [ 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17,
    16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33,
    38, 39, 36, 37, 42, 43, 40, 41, 46, 44, 51, 49, 48, 55, 54, 53, 52, 59, 58,
    57, 56, 63, 62, 61, 60, 68, 69, 70, 71, 64, 65, 66, 67, 76, 77, 78, 79, 72,
    73, 74, 75, 85, 87, 86, 80, 83, 82, 95, 89, 88, 91, 90, 100, 101, 98, 99,
    96, 97, 111, 109, 118, 117, 115, 114, 113, 112, 123, 122 ],
    "etcHostsError" : null,
    "etcHostsMessages" : [ ],
    "etcKrbConfMessages" : [ ],
    "extantInitdErrors" : [ ],
    "groupData" :
    "zookeeper:x:217:\ncloudera-scm:x:215:\nhadoop:x:1030:\n",
    "hostDnsErrors" : [ ],
    "hostname" : "prod1.xxx.com",
    "jceStrength" : 0,
    "kernelVersion" : "3.2.12-3.2.4.amzn1.x86_64",
    "kernelVersionException" : null,
    "localHostIpError" : null,
    "localhostIp" : "127.0.0.1",
    "nowMillis" : 1382998582282,
    "rhelRelease" : null,
    "runExceptions" : [ ],
    "timeZone" : "UTC+00:00",
    "transparentHugePagesDefrag" : null,
    "transparentHugePagesEnabled" : null,
    "transparentHugePagesException" : null,
    "userData" :
    "hdfs:x:1030:1030:hdfs@xxx.com:
    /home/hdfs:/bin/bash\nmapred:x:1031:1030:mapred@xxx.com:
    /home/mapred:/bin/bash\nzookeeper:x:217:217:ZooKeeper:/var/run/zookeeper:/sbin/nologin\noozie:x:1032:1030:oozie@xxx.com:
    /home/oozie:/bin/bash\ncloudera-scm:x:215:215:Cloudera
    Manager:/var/run/cloudera-scm-server:/sbin/nologin\n"

    }


    Thanks,
    Stefano.




    On 28 October 2013 18:44, Herman Chen wrote:

    Hi Stefano

    To address the issue, you can either re-run the host upgrade wizard
    (Hosts->Re-run Host Upgrade Wizard), or manually update the agent
    package on those hosts with outdated agents.

    What error did you run into with host inspector? It'd be helpful if
    you attach the CM server log.

    Herman

    On Mon, Oct 28, 2013 at 3:36 PM, Stefano Guidolin <
    st.guido@gmail.com>
    wrote:
    Hi,

    I'm using cloudera manager to distribute some parcels and (for a
    couple
    of
    hosts) I get the following error message:

    Error while downloading parcel CDH-4.1.4-1.cdh4.1.4.p0.11-unknown
    : One
    or
    more hosts did not report their OS Distribution. This is likely
    due to
    running an outdated version of the Cloudera Manager Agent. Please
    run
    the
    Host Inspector to check the Agent versions..

    And, indeed, on those hosts the cloudera manager status page
    doesn't
    report
    any distribution. I've tried running the host inspector multiple
    times,
    without any success.

    Is there a way to set manually the host's distribution? If not,
    what
    should
    be the course of action when the host's distribution is unknown?

    Thanks,
    Stefano.

    To unsubscribe from this group and stop receiving emails from it,
    send
    an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send
    an email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedOct 28, '13 at 10:36p
activeOct 29, '13 at 9:39p
posts9
users3
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase