FAQ
Hi,

Just installed CDH 4.1.3 with Cloudera Manager. This is a single node
install in a vmware image running RHEL 6.2. Install works and everything
starts except the tasktracker.

In the Jobtracker log I see some exceptions:

*********************************************************

2013-02-20 11:26:29,985 INFO org.apache.hadoop.util.HostsFileReader: Adding
localhost.localdomain to the list of hosts from
/var/run/cloudera-scm-agent/process/13-mapreduce-JOBTRACKER/mapred_hosts_allow.txt
2013-02-20 11:26:29,985 INFO org.apache.hadoop.util.HostsFileReader: Adding
127.0.0.1 to the list of hosts from
/var/run/cloudera-scm-agent/process/13-mapreduce-JOBTRACKER/mapred_hosts_allow.txt
2013-02-20 11:26:29,985 INFO org.apache.hadoop.mapred.JobTracker:
Decommissioning 0 nodes
2013-02-20 11:26:29,986 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2013-02-20 11:26:29,986 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 8021: starting
2013-02-20 11:26:29,989 INFO org.apache.hadoop.mapred.JobTracker: Starting
RUNNING
2013-02-20 11:26:30,524 ERROR
org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
as:mapred (auth:SIMPLE)
cause:org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker
denied communication with jobtracker:
tracker_localhost:localhost/127.0.0.1:44065
2013-02-20 11:26:30,524 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 8021, call
heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@25861086, true, true,
true, -1), rpc version=2, client version=32, methodsFingerPrint=-159967141
from 127.0.0.1:50153: error:
org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker denied
communication with jobtracker: tracker_localhost:localhost/127.0.0.1:44065
org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker denied
communication with jobtracker: tracker_localhost:localhost/127.0.0.1:44065
at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2857)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:898)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1693)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1689)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1687)
2013-02-20 11:26:34,111 ERROR
org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
as:mapred (auth:SIMPLE)
cause:org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker
denied communication with jobtracker:
tracker_localhost:localhost/127.0.0.1:59167
2013-02-20 11:26:34,111 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 8021, call
heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@4c4b11e9, true, true,
true, -1), rpc version=2, client version=32, methodsFingerPrint=-159967141
from 127.0.0.1:50157: error:
org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker denied
communication with jobtracker: tracker_localhost:localhost/127.0.0.1:59167
org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker denied
communication with jobtracker: tracker_localhost:localhost/127.0.0.1:59167
*****************************************
I also see this in the tasktracker log:
******************************************
2013-02-20 11:58:06,568 WARN org.apache.hadoop.mapred.TaskTracker:
TaskTracker's totalMemoryAllottedForTasks is -1 and reserved physical
memory is not configured. TaskMemoryManager is disabled.
******************************************




Any help is appreciated.

Thanks,
Jim

Search Discussions

  • Jlwill20 at Feb 20, 2013 at 8:54 pm
    Issue Resolved:
    I should have read the other posts/replies more carefully. This had to do
    with /etc/hosts. I played around with it and the tasktracker started.
    By played around I mean I added the actual ip address rather than 127.0.0.1

    Jim
    On Wednesday, February 20, 2013 3:44:41 PM UTC-5, jlwi...@gmail.com wrote:

    Hi,

    Just installed CDH 4.1.3 with Cloudera Manager. This is a single node
    install in a vmware image running RHEL 6.2. Install works and everything
    starts except the tasktracker.

    In the Jobtracker log I see some exceptions:

    *********************************************************

    2013-02-20 11:26:29,985 INFO org.apache.hadoop.util.HostsFileReader:
    Adding localhost.localdomain to the list of hosts from
    /var/run/cloudera-scm-agent/process/13-mapreduce-JOBTRACKER/mapred_hosts_allow.txt
    2013-02-20 11:26:29,985 INFO org.apache.hadoop.util.HostsFileReader:
    Adding 127.0.0.1 to the list of hosts from
    /var/run/cloudera-scm-agent/process/13-mapreduce-JOBTRACKER/mapred_hosts_allow.txt
    2013-02-20 11:26:29,985 INFO org.apache.hadoop.mapred.JobTracker:
    Decommissioning 0 nodes
    2013-02-20 11:26:29,986 INFO org.apache.hadoop.ipc.Server: IPC Server
    Responder: starting
    2013-02-20 11:26:29,986 INFO org.apache.hadoop.ipc.Server: IPC Server
    listener on 8021: starting
    2013-02-20 11:26:29,989 INFO org.apache.hadoop.mapred.JobTracker: Starting
    RUNNING
    2013-02-20 11:26:30,524 ERROR
    org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
    as:mapred (auth:SIMPLE)
    cause:org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker
    denied communication with jobtracker: tracker_localhost:localhost/
    127.0.0.1:44065
    2013-02-20 11:26:30,524 INFO org.apache.hadoop.ipc.Server: IPC Server
    handler 3 on 8021, call
    heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@25861086, true, true,
    true, -1), rpc version=2, client version=32, methodsFingerPrint=-159967141
    from 127.0.0.1:50153: error:
    org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker denied
    communication with jobtracker: tracker_localhost:localhost/127.0.0.1:44065
    org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker
    denied communication with jobtracker: tracker_localhost:localhost/
    127.0.0.1:44065
    at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2857)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:898)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1693)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1689)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1687)
    2013-02-20 11:26:34,111 ERROR
    org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
    as:mapred (auth:SIMPLE)
    cause:org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker
    denied communication with jobtracker: tracker_localhost:localhost/
    127.0.0.1:59167
    2013-02-20 11:26:34,111 INFO org.apache.hadoop.ipc.Server: IPC Server
    handler 7 on 8021, call
    heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@4c4b11e9, true, true,
    true, -1), rpc version=2, client version=32, methodsFingerPrint=-159967141
    from 127.0.0.1:50157: error:
    org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker denied
    communication with jobtracker: tracker_localhost:localhost/127.0.0.1:59167
    org.apache.hadoop.mapred.DisallowedTaskTrackerException: Tasktracker
    denied communication with jobtracker: tracker_localhost:localhost/
    127.0.0.1:59167
    *****************************************
    I also see this in the tasktracker log:
    ******************************************
    2013-02-20 11:58:06,568 WARN org.apache.hadoop.mapred.TaskTracker:
    TaskTracker's totalMemoryAllottedForTasks is -1 and reserved physical
    memory is not configured. TaskMemoryManager is disabled.
    ******************************************




    Any help is appreciated.

    Thanks,
    Jim


Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedFeb 20, '13 at 8:44p
activeFeb 20, '13 at 8:54p
posts2
users1
websitecloudera.com
irc#hadoop

1 user in discussion

Jlwill20: 2 posts

People

Translate

site design / logo © 2022 Grokbase