FAQ
The test TestMiniMRWithDFS.checkTaskDirectories is checking for task directories incorrectly
--------------------------------------------------------------------------------------------

Key: HADOOP-4409
URL: https://issues.apache.org/jira/browse/HADOOP-4409
Project: Hadoop Core
Issue Type: Test
Components: mapred, test
Reporter: Hemanth Yamijala


The check for task directories in {{TestMiniMRWithDFS.checkTaskDirectories}} seems incorrect. The following code:
{code}
assertTrue("task tracker dir " + trackerDir + " does not exist.",
trackerDir.isDirectory());
{code}
in the test case seems to assume that every configured task tracker has the task tracker directory {{TaskTracker.SUBDIR}} created. However, this directory is only created if any task is assigned to the task tracker. As there is no real control over which task trackers will actually be assigned tasks, it seems an incorrect check.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Hemanth Yamijala (JIRA) at Oct 14, 2008 at 7:12 am
    [ https://issues.apache.org/jira/browse/HADOOP-4409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12639322#action_12639322 ]

    Hemanth Yamijala commented on HADOOP-4409:
    ------------------------------------------

    The issue is somewhat random, though it is replicable on some machines consistently. One way I could consistently replicate it is to modify the {{TestMiniMRWithDFS.testWithDFS}} method to run only the word count example, and comment out the PI example. Such a modification caused the following failure:
    {code}
    task tracker dir /home/yhemanth/work/hadoop/hadoop-trunk/build/test/mapred/local/1_0/taskTracker does not exist.
    junit.framework.AssertionFailedError: task tracker dir /home/yhemanth/work/hadoop/hadoop-trunk/build/test/mapred/local/1_0/taskTracker does not exist.
    at org.apache.hadoop.mapred.TestMiniMRWithDFS.checkTaskDirectories(TestMiniMRWithDFS.java:140)
    at org.apache.hadoop.mapred.TestMiniMRWithDFS.runWordCount(TestMiniMRWithDFS.java:196)
    at org.apache.hadoop.mapred.TestMiniMRWithDFS.testWithDFS(TestMiniMRWithDFS.java:244)
    {code}
    The test TestMiniMRWithDFS.checkTaskDirectories is checking for task directories incorrectly
    --------------------------------------------------------------------------------------------

    Key: HADOOP-4409
    URL: https://issues.apache.org/jira/browse/HADOOP-4409
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Reporter: Hemanth Yamijala

    The check for task directories in {{TestMiniMRWithDFS.checkTaskDirectories}} seems incorrect. The following code:
    {code}
    assertTrue("task tracker dir " + trackerDir + " does not exist.",
    trackerDir.isDirectory());
    {code}
    in the test case seems to assume that every configured task tracker has the task tracker directory {{TaskTracker.SUBDIR}} created. However, this directory is only created if any task is assigned to the task tracker. As there is no real control over which task trackers will actually be assigned tasks, it seems an incorrect check.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedOct 14, '08 at 7:08a
activeOct 14, '08 at 7:12a
posts2
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hemanth Yamijala (JIRA): 2 posts

People

Translate

site design / logo © 2021 Grokbase