FAQ
Hi all,

We've encounterd an "ERROR ...EagerTaskInitializationListener: Job
initialization failed" on our hadoop 0.19.2 cluster.
Reading the job tracker log, it seems that the job tracker tries to get a
history file name from local file system on job tracker.
Why does it try to get this old file?
The file ".jt_1283752186987_job_201009061449_0801_user_sss.crc" in the log
below
had been generated more than 30 days ago and possibly been deleted by
HistoryCleaner.

2010-10-11 07:10:06,517 ERROR
org.apache.hadoop.mapred.EagerTaskInitializationListener: Job initialization
failed:
java.io.FileNotFoundException: File
file:/xxx/history/.jt_1283752186987_job_201009061449_0801_user_sss.crc does
not exist.
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420)
at
org.apache.hadoop.fs.RawLocalFileSystem.listStatus(RawLocalFileSystem.java:297)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:723)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:748)
at
org.apache.hadoop.fs.ChecksumFileSystem.listStatus(ChecksumFileSystem.java:457)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:723)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:748)
at
org.apache.hadoop.mapred.JobHistory$JobInfo.getJobHistoryFileName(JobHistory.java:662)
at
org.apache.hadoop.mapred.JobHistory$JobInfo.logSubmitted(JobHistory.java:805)
at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:360)
at
org.apache.hadoop.mapred.EagerTaskInitializationListener$JobInitThread.run(EagerTaskInitializationListener.java:55)
at java.lang.Thread.run(Thread.java:619)


Plus, is HistoryCleaner only way to delete old history files? I just want to
know when an by what the file
".jt_1283752186987_job_201009061449_0801_user_sss.crc" has been deleted.


Thanks,
Manhee

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 1 of 1 | next ›
Discussion Overview
groupcommon-user @
categorieshadoop
postedOct 19, '10 at 11:16a
activeOct 19, '10 at 11:16a
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Manhee Jo: 1 post

People

Translate

site design / logo © 2022 Grokbase