FAQ
Hi all,

I notice that during namenode startup, cloudera-scm-agent creates a file "dfs_hosts_allow.txt"
under:
/run/cloudera-scm-agent/process/xxx-hdfs-NAMENODE/dfs_hosts_allow.txt
For the IP's listed in that file, when does the DNS resolution happen? I
wanted to route all traffic over a different interface (i.e. eth1, private
vs eth0, public), but am getting datanode rejection errors because the
private IPs of the datanodes are not listed in that file.
I.e. the file has public IPs, but the datanodes use /etc/hosts on the box
to publish their private IP addresses. The mismatch causes the namenode to
reject the datanodes.

Thanks,
--Young


CM version 4.0.3.

Search Discussions

  • Young at Aug 7, 2012 at 11:54 pm
    nslookup on the FQDN of the boxes resolve to the public IP address.
    I have specified an alternate nameserver under dfs.datanode.dns.nameserver
    which resolves the FQDN's to the private IPs. However, it seems like
    dfs_hosts_allow.txt is still putting in the public IP addresses.
    On Tuesday, August 7, 2012 4:44:51 PM UTC-7, Young wrote:

    Hi all,

    I notice that during namenode startup, cloudera-scm-agent creates a file "dfs_hosts_allow.txt"
    under:
    /run/cloudera-scm-agent/process/xxx-hdfs-NAMENODE/dfs_hosts_allow.txt
    For the IP's listed in that file, when does the DNS resolution happen? I
    wanted to route all traffic over a different interface (i.e. eth1, private
    vs eth0, public), but am getting datanode rejection errors because the
    private IPs of the datanodes are not listed in that file.
    I.e. the file has public IPs, but the datanodes use /etc/hosts on the box
    to publish their private IP addresses. The mismatch causes the namenode to
    reject the datanodes.

    Thanks,
    --Young


    CM version 4.0.3.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedAug 7, '12 at 11:44p
activeAug 7, '12 at 11:54p
posts2
users1
websitecloudera.com
irc#hadoop

1 user in discussion

Young: 2 posts

People

Translate

site design / logo © 2022 Grokbase