FAQ
TT should fail task immediately if userlog dir cannot be created
----------------------------------------------------------------

Key: MAPREDUCE-2592
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2592
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: tasktracker
Affects Versions: 0.23.0
Reporter: Todd Lipcon
Fix For: 0.23.0


Currently, TaskRunner will log the message "mkdirs failed. Ignoring" if it fails to mkdir the userlog directory for a task. Then, it goes on to spawn taskjvm.sh which tries to redirect output into the userlogs dir, thus failing with exit code 1. This leads to error messages that are very hard to diagnose ("task failed with exit status 1") in cases where the userlog directory has either become inaccessible or has reached the maximum number of dirents (32000 in ext3)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmapreduce-dev @
categorieshadoop
postedJun 14, '11 at 6:35p
activeJun 14, '11 at 6:35p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Todd Lipcon (JIRA): 1 post

People

Translate

site design / logo © 2022 Grokbase