FAQ
The FileSystem operations in JobInProgress.garbageCollect should be moved out of the synchronized block
-------------------------------------------------------------------------------------------------------

Key: HADOOP-3358
URL: https://issues.apache.org/jira/browse/HADOOP-3358
Project: Hadoop Core
Issue Type: Bug
Reporter: Devaraj Das
Assignee: Devaraj Das
Fix For: 0.18.0


In garbageCollect, the jobTracker deletes files in the filesystem but that is after locking the JobTracker/JobInProgress. This should be changed to move the filesystem operations outside the locks. I encountered HADOOP-3357 and that effectively locked up the jobTracker.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Mukund Madhugiri (JIRA) at Jun 7, 2008 at 1:28 am
    [ https://issues.apache.org/jira/browse/HADOOP-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mukund Madhugiri updated HADOOP-3358:
    -------------------------------------

    Fix Version/s: (was: 0.18.0)
    The FileSystem operations in JobInProgress.garbageCollect should be moved out of the synchronized block
    -------------------------------------------------------------------------------------------------------

    Key: HADOOP-3358
    URL: https://issues.apache.org/jira/browse/HADOOP-3358
    Project: Hadoop Core
    Issue Type: Bug
    Reporter: Devaraj Das
    Assignee: Devaraj Das

    In garbageCollect, the jobTracker deletes files in the filesystem but that is after locking the JobTracker/JobInProgress. This should be changed to move the filesystem operations outside the locks. I encountered HADOOP-3357 and that effectively locked up the jobTracker.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod K V (JIRA) at Feb 24, 2009 at 8:32 am
    [ https://issues.apache.org/jira/browse/HADOOP-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Vinod K V resolved HADOOP-3358.
    -------------------------------

    Resolution: Duplicate

    HADOOP-5285 fixed this.
    The FileSystem operations in JobInProgress.garbageCollect should be moved out of the synchronized block
    -------------------------------------------------------------------------------------------------------

    Key: HADOOP-3358
    URL: https://issues.apache.org/jira/browse/HADOOP-3358
    Project: Hadoop Core
    Issue Type: Bug
    Reporter: Devaraj Das
    Assignee: Devaraj Das

    In garbageCollect, the jobTracker deletes files in the filesystem but that is after locking the JobTracker/JobInProgress. This should be changed to move the filesystem operations outside the locks. I encountered HADOOP-3357 and that effectively locked up the jobTracker.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedMay 7, '08 at 11:31a
activeFeb 24, '09 at 8:32a
posts3
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Vinod K V (JIRA): 3 posts

People

Translate

site design / logo © 2023 Grokbase