FAQ
Hey,

I got CDH3u0 installed. I am trying to setup a single node configuration. I
got name node, data node and job tracker up and running. But when I try to
start the task tracker I got the following error message in log:

/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG: host = matthew-desktop/127.0.1.1
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2-cdh3u0
STARTUP_MSG: build = -r 81256ad0f2e4ab2bd34b04f53d25a6c23686dd14;
compiled by 'root' on Sat Mar 26 00:14:04 UTC 2011
************************************************************/
2011-04-18 11:45:08,606 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2011-04-18 11:45:08,644 INFO org.apache.hadoop.http.HttpServer: Added global
filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2011-04-18 11:45:08,660 INFO org.apache.hadoop.mapred.TaskLogsTruncater:
Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2011-04-18 11:45:08,663 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tasktracker with owner as mapred
2011-04-18 11:45:08,665 WARN org.apache.hadoop.mapred.TaskTracker: Task
Tracker local File /app/hadoop/tmp/mapred/local does not exist.
2011-04-18 11:45:08,665 ERROR org.apache.hadoop.mapred.TaskTracker: Can not
start task tracker because
org.apache.hadoop.util.DiskChecker$DiskErrorException: all local directories
are not writable
at
org.apache.hadoop.mapred.TaskTracker.checkLocalDirs(TaskTracker.java:3495)
at
org.apache.hadoop.mapred.TaskTracker.initializeDirectories(TaskTracker.java:659)
at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:734)
at org.apache.hadoop.mapred.TaskTracker.(TaskTracker.java:3521)

2011-04-18 11:45:08,670 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at matthew-desktop/127.0.1.1


mapred-site.xml:
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>localhost:50033</value>
</property>
<property>
<name>mapred.system.dir</name>
<value>/mapred/system</value>
</property>
<property>
<name>mapred.local.dir</name>
<value>/app/hadoop/tmp/mapred/local</value>
</property>
<property>
<name>mapred.tmp.dir</name>
<value>/app/hadoop/tmp/mapred/temp</value>
</property>
</configuration>v


matthew@matthew-desktop:~$ sudo ls -ltrh /app/hadoop/tmp/mapred/
total 12K
drwxr-xr-x 2 mapred hadoop 4.0K 2011-04-18 11:24 local
drwxr-xr-x 2 mapred hadoop 4.0K 2011-04-18 11:31 system
drwxr-xr-x 2 mapred hadoop 4.0K 2011-04-18 11:31 temp



Any ideas?

Search Discussions

  • Matthew Tovbin at Apr 18, 2011 at 9:27 am
    Got all working.

    /app/hadoop/tmp required 755

    On Mon, Apr 18, 2011 at 11:46, Matthew Tovbin wrote:

    Hey,

    I got CDH3u0 installed. I am trying to setup a single node configuration. I
    got name node, data node and job tracker up and running. But when I try to
    start the task tracker I got the following error message in log:

    /************************************************************
    STARTUP_MSG: Starting TaskTracker
    STARTUP_MSG: host = matthew-desktop/127.0.1.1
    STARTUP_MSG: args = []
    STARTUP_MSG: version = 0.20.2-cdh3u0
    STARTUP_MSG: build = -r 81256ad0f2e4ab2bd34b04f53d25a6c23686dd14;
    compiled by 'root' on Sat Mar 26 00:14:04 UTC 2011
    ************************************************************/
    2011-04-18 11:45:08,606 INFO org.mortbay.log: Logging to
    org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
    org.mortbay.log.Slf4jLog
    2011-04-18 11:45:08,644 INFO org.apache.hadoop.http.HttpServer: Added
    global filtersafety
    (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
    2011-04-18 11:45:08,660 INFO org.apache.hadoop.mapred.TaskLogsTruncater:
    Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
    2011-04-18 11:45:08,663 INFO org.apache.hadoop.mapred.TaskTracker: Starting
    tasktracker with owner as mapred
    2011-04-18 11:45:08,665 WARN org.apache.hadoop.mapred.TaskTracker: Task
    Tracker local File /app/hadoop/tmp/mapred/local does not exist.
    2011-04-18 11:45:08,665 ERROR org.apache.hadoop.mapred.TaskTracker: Can not
    start task tracker because
    org.apache.hadoop.util.DiskChecker$DiskErrorException: all local directories
    are not writable
    at
    org.apache.hadoop.mapred.TaskTracker.checkLocalDirs(TaskTracker.java:3495)
    at
    org.apache.hadoop.mapred.TaskTracker.initializeDirectories(TaskTracker.java:659)
    at
    org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:734)
    at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1431)
    at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3521)

    2011-04-18 11:45:08,670 INFO org.apache.hadoop.mapred.TaskTracker:
    SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down TaskTracker at matthew-desktop/127.0.1.1


    mapred-site.xml:
    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
    <configuration>
    <property>
    <name>mapred.job.tracker</name>
    <value>localhost:50033</value>
    </property>
    <property>
    <name>mapred.system.dir</name>
    <value>/mapred/system</value>
    </property>
    <property>
    <name>mapred.local.dir</name>
    <value>/app/hadoop/tmp/mapred/local</value>
    </property>
    <property>
    <name>mapred.tmp.dir</name>
    <value>/app/hadoop/tmp/mapred/temp</value>
    </property>
    </configuration>v


    matthew@matthew-desktop:~$ sudo ls -ltrh /app/hadoop/tmp/mapred/
    total 12K
    drwxr-xr-x 2 mapred hadoop 4.0K 2011-04-18 11:24 local
    drwxr-xr-x 2 mapred hadoop 4.0K 2011-04-18 11:31 system
    drwxr-xr-x 2 mapred hadoop 4.0K 2011-04-18 11:31 temp



    Any ideas?





Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedApr 18, '11 at 9:27a
activeApr 18, '11 at 4:30p
posts2
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Matthew Tovbin: 2 posts

People

Translate

site design / logo © 2022 Grokbase