FAQ
A bunch of mapred unit tests are failing on Windows
---------------------------------------------------

Key: HADOOP-5114
URL: https://issues.apache.org/jira/browse/HADOOP-5114
Project: Hadoop Core
Issue Type: Test
Components: mapred, test
Affects Versions: 0.20.0
Environment: Windows
Reporter: Ramya R
Priority: Minor
Fix For: 0.20.0


A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:

Exception: "java.net.ConnectException: Connection refused: no further information"
Failing tests:
* TestMiniMRMapRedDebugScript - testMapDebugScript
* TestNoDefaultsJobConf - testNoDefaults
* TestQueueManager - testAllEnabledACLForJobSubmission
* TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
* TestJobInProgressListener - testJobQueueChanges
* TestKillCompletedJob - testKillCompJob
* TestMiniMRClasspath - testClassPath
* TestMiniMRDFSCaching - testWithDFS
* TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
* TestSetupAndCleanupFailure - testWithDFS
* TestDBJob - testRun
* TestMiniMRWithDFS - testWithDFS
* TestJobStatusPersistency - testNonPersistency
* TestSpecialCharactersInOutputPath - testJobWithDFS
* TestUserDefinedCounters - testMapReduceJob
* TestDelegatingInputFormat - testSplitting
* TestEmptyJobWithDFS - testEmptyJobWithDFS
* TestJavaSerialization - testMapReduceJob
* TestClusterMapReduceTestCase - testMapReduce


Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
Failing tests:
* TestJobInProgress - testRunningTaskCount
* TestJobQueueInformation - testJobQueues
* TestJobTrackerRestart - testJobTrackerRestart


Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
Failing tests:
* TestJobSysDirWithDFS - testWithDFS
* TestJobInProgress - testPendingMapTaskCount
* TestMiniMRDFSSort - testMapReduceSort


Exception: junit.framework.AssertionFailedError
Failing tests:
* TestMRServerPorts - testJobTrackerPorts
* TestMRServerPorts - testTaskTrackerPorts
* TestMiniMRTaskTempDir - testTaskTempDir


Exception: java.io.IOException: Job failed!
Failing tests:
* TestMiniMRLocalFS - testWithLocal


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Nigel Daley (JIRA) at Jan 23, 2009 at 6:00 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666630#action_12666630 ]

    Nigel Daley commented on HADOOP-5114:
    -------------------------------------

    If this is true, and no one has report Windows test failures before now (we haven't run Windows tests in a while), then should we continue to support Windows? Is anyone motivated to fix these?
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Jan 23, 2009 at 7:54 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666674#action_12666674 ]

    Tsz Wo (Nicholas), SZE commented on HADOOP-5114:
    ------------------------------------------------
    If this is true, and no one has report Windows test failures before now (we haven't run Windows tests in a while), then should we continue to support Windows?
    Before answering whether we should continue to support Windows, we better make sure that "this is true". I ran first 4 tests listed in the description, TestQueueManager did success in my machine.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Doug Cutting (JIRA) at Jan 23, 2009 at 8:12 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666680#action_12666680 ]

    Doug Cutting commented on HADOOP-5114:
    --------------------------------------

    I think this shows that not many who use trunk also use Windows. That doesn't mean that lots of folks who use releases don't use Windows. Before we consider dropping Windows support we should probably poll core-user.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Steve Loughran (JIRA) at Jan 23, 2009 at 8:22 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666683#action_12666683 ]

    Steve Loughran commented on HADOOP-5114:
    ----------------------------------------

    I think its important to make sure the client side all works on windows, regardless of what your server architecture is.

    If so many tests are failling there is likely to be one or two root causes. I can test against SVN head on a vmware XP or Vista image and see what happens
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Doug Cutting (JIRA) at Jan 23, 2009 at 8:34 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666690#action_12666690 ]

    Doug Cutting commented on HADOOP-5114:
    --------------------------------------
    I think its important to make sure the client side all works on windows, regardless of what your server architecture is.
    If we only supported Windows clients, how would we support debugging on Windows LocalRunner? MiniDFS and MiniMR (i.e., running a cluster in a single JVM)? Debugging with multiple JVMs (a.k.a "pseudo-distributed") catches lots of problems that are hard to catch with a single JVM, e.g., relative path and classpath issues.

    Also, if we wish to support client-side only, then we'd need to test that automatically, which might mean we:
    - start a standalone cluster on a linux host
    - start a virtual windows box on that linux host that runs client tests against the linux-based cluster.

    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Konstantin Shvachko (JIRA) at Jan 23, 2009 at 8:58 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666704#action_12666704 ]

    Konstantin Shvachko commented on HADOOP-5114:
    ---------------------------------------------

    I have TestCLI falling into infinite loop with {{java.net.ConnectException: Connection refused: no further information}}, which is thrown from {{SocketIOWithTimeout.connect()}} when it does {{channel.finishConnect()}}.
    This code was introduced in HADOOP-4346.
    Raghu, could you please take a look.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Steve Loughran (JIRA) at Jan 23, 2009 at 10:22 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666745#action_12666745 ]

    Steve Loughran commented on HADOOP-5114:
    ----------------------------------------
    If we only supported Windows clients, how would we support debugging on Windows LocalRunner?
    I agree, testing across platforms adds a lot of extra pain, which is unfair in the OSS world. You wouldn't be able to accept any contributions from windows-based developers, not if you expect their patches to pass the tests before submission.


    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 27, 2009 at 10:06 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667470#action_12667470 ]

    Raghu Angadi commented on HADOOP-5114:
    --------------------------------------
    From the log that Kostantin gave me, it it not a connect() related problem. The DataNode Xceiver thread fails to accept connections with this exception :
    {noformat}[...] DataXceiveServer: Exiting due to:java.nio.channels.ClosedSelectorException
    [junit] at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:66)
    [junit] at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:88)
    [junit] at sun.nio.ch.Util.releaseTemporarySelector(Util.java:135)
    [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:120)
    [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130)
    [junit] at java.lang.Thread.run(Thread.java:619)
    {noformat}

    Because of this, later attempts by clients to connect to DN fails with "connection refused" exceptions.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 27, 2009 at 10:07 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667532#action_12667532 ]

    Raghu Angadi commented on HADOOP-5114:
    --------------------------------------

    Right. I don't like interrupt either. But {{DataNode.shutdown()}} does interrupt the thread. Not sure if that necessary or not.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0

    Attachments: tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 27, 2009 at 10:08 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667481#action_12667481 ]

    Raghu Angadi commented on HADOOP-5114:
    --------------------------------------

    HADOOP-4679 sets a 30 second timeout for the ServerSocket used by DataXceiver thread. This server socket is a NIO socket. Tests seem to pass after commenting out timeout setting. This seems to be yet another problem we are seeing with Sun JDK's selectors. Blocking IO with JDK NIO sockets is pretty buggy and unusable.. it works well only for the common use case of NIO : use a static thread pool for non-blocking IO.

    Couple of options :

    * Use Hadoop's selector to wait on the socket ({{SocketIOWithTimeout}})
    * May be a timeout is not necessary, if interrupting the thread wakes this thread.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 27, 2009 at 10:11 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667472#action_12667472 ]

    Raghu Angadi commented on HADOOP-5114:
    --------------------------------------

    Note that "Selector" in the above trace is a JDKs own internal selector. It is not a selector managed by Hadoop.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hairong Kuang (JIRA) at Jan 27, 2009 at 10:13 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667529#action_12667529 ]

    Hairong Kuang commented on HADOOP-5114:
    ---------------------------------------

    Does this NIO bug occurs only in Windows? I normally is not a fan of "interrupt". I'd vote for option 1.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0

    Attachments: tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Konstantin Shvachko (JIRA) at Jan 27, 2009 at 10:14 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Konstantin Shvachko updated HADOOP-5114:
    ----------------------------------------

    Attachment: tmp.log

    Attaching the log Raghu mentioned.
    Looks like we have just one problem which makes all these tests fail.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.20.0
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.20.0

    Attachments: tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 28, 2009 at 12:53 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Affects Version/s: (was: 0.20.0)
    0.18.3
    Fix Version/s: (was: 0.20.0)
    0.18.3
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Priority: Minor
    Fix For: 0.18.3

    Attachments: tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 28, 2009 at 1:29 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi reassigned HADOOP-5114:
    ------------------------------------

    Assignee: Raghu Angadi
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 28, 2009 at 2:11 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Attachment: HADOOP-5114.patch


    Patch for the first option (accept waits using Hadoop selectors) is attached. Tests pass

    I still want to check why exactly is the timeout for accept() required.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod K V (JIRA) at Jan 28, 2009 at 6:07 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667940#action_12667940 ]

    Vinod K V commented on HADOOP-5114:
    -----------------------------------

    bq. Does this NIO bug occurs only in Windows?
    I have seen this occassionally on Linux too. A while back, tests based on MiniDFS used to fail on my ubuntu machine with precisely the same exception, and now they finish successfully.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod K V (JIRA) at Jan 28, 2009 at 6:13 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667941#action_12667941 ]

    Vinod K V commented on HADOOP-5114:
    -----------------------------------

    bq. A while back, tests based on MiniDFS used to fail on my ubuntu machine with precisely the same exception, and now they finish successfully.
    This definitely must be related to the sun jdk. Earlier I was using sun jdk, but now I am on openjdk.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ramya R (JIRA) at Jan 28, 2009 at 10:53 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667993#action_12667993 ]

    Ramya R commented on HADOOP-5114:
    ---------------------------------

    I ran all the unit tests on Windows a couple of times and observed close to 50 tests failing each time. Besides the above mentioned tests, there are a variety of hdfs, conf, security, cli, tools, fs tests which are failing as well on Windows due to similar kind of errors.
    Following is the list of failing tests besides the above reported tests. Some are sporadically failing and some are consistently failing.

    * Exception: java.io.IOException: Could not obtain block: <Blk_id> file=/<filename>
    ** Consistently failing tests:
    *** TestDFSUpgradeFromImage - testUpgradeFromImage

    * Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    ** Consistent failing tests:
    *** TestDecommission - testDecommission
    *** TestModTime - testModTime
    *** TestServiceLevelAuthorization - testServiceLevelAuthorization
    ** Sporadically failing tests:
    *** TestDFSClientRetries - testWriteTimeoutAtDataNode
    *** TestLeaseRecovery - testBlockSynchronization
    *** TestBlockReplacement - testBlockReplacement
    *** TestNameEditsConfigs - testNameEditsConfigs

    * Exception: "java.net.ConnectException: Connection refused: no further information"
    ** Consistent failing tests:
    *** TestRestartDFS - testRestartDFS
    *** TestNoDefaultsJobConf - testNoDefaults
    ** Sporadically failing tests:
    *** TestFileAppend3 - testTC1, testTC7, testTC11
    *** TestDistCh - testDistCh
    *** TestHarFileSystem - testArchives

    * Exception: junit.framework.AssertionFailedError
    ** Consistent failing tests:
    *** TestHDFSServerPorts - testNameNodePorts
    *** TestHDFSServerPorts - testDataNodePorts
    *** TestHDFSServerPorts - testSecondaryNodePorts
    *** TestOverReplicatedBlocks - testProcesOverReplicateBlock

    * Exception: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.security.authorize.AuthorizationException: java.security.AccessControlException: access denied ConnectionPermission(org.apache.hadoop.security.authorize.RefreshAuthorizationPolicyProtocol)
    ** Consistent failing tests:
    *** TestServiceLevelAuthorization - testRefresh

    * Timeout:
    ** Consistent failing tests:
    *** TestCLI - testAll
    *** TestDiskError - testShutdown
    ** Sporadically failing tests:
    *** TestDatanodeDeath - testSimple0
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 28, 2009 at 5:00 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668075#action_12668075 ]

    Raghu Angadi commented on HADOOP-5114:
    --------------------------------------

    Ramya, did you use the patch I attached?
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ramya R (JIRA) at Jan 29, 2009 at 8:46 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668377#action_12668377 ]

    Ramya R commented on HADOOP-5114:
    ---------------------------------

    bq. Ramya, did you use the patch I attached?
    No I have not tested with the patch. The above observations were without the patch.
    I shall re-run the tests with the patch and update the issue.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 30, 2009 at 1:49 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668704#action_12668704 ]

    Raghu Angadi commented on HADOOP-5114:
    --------------------------------------


    Thanks.

    TestDiskError still fails on windows. I think for the same reason as TestLocalDirAllocator (HADOOP-2023) and should be disabled, probably in a separate jira.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ramya R (JIRA) at Jan 30, 2009 at 4:23 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668738#action_12668738 ]

    Ramya R commented on HADOOP-5114:
    ---------------------------------

    I ran all the tests after applying the patch. The number of failing tests has reduced drastically. But a few tests still continue to fail.
    Below is the list of failing tests after applying the patch. I have attached logs as well for some of the failing tests:

    * org.apache.hadoop.fs.TestTrash.testTrash, org.apache.hadoop.fs.TestTrash.testNonDefaultFS
    Output:
    2009-01-29 15:01:20,243 WARN fs.Trash (Trash.java:moveToTrash(125)) - Can't create trash directory: file :/$HADOOP_HOME/build/test/data/testTrash/.Trash/Current/$HADOOP_HOME/build/test/data/testTrash/test/mkdirs
    Deleted file :/$HADOOP_HOME/build/test/data/testTrash/test/mkdirs/myFile
    2009-01-29 15:01:20,399 WARN fs.Trash (Trash.java:moveToTrash(125)) - Can't create trash directory: file :/$HADOOP_HOME/build/test/data/testTrash/.Trash/Current/$HADOOP_HOME/build/test/data/testTrash

    * org.apache.hadoop.hdfs.TestDFSRollback.testRollback
    Stacktrace:
    java.io.IOException: Cannot lock storage $HADOOP_HOME\build\test\data\name1. The directory is already locked.

    * org.apache.hadoop.hdfs.TestHDFSTrash.testNonDefaultFS - logs attached

    * org.apache.hadoop.mapred.TestJobInProgress.testRunningTaskCount
    Stacktrace:
    java.lang.IllegalArgumentException: Pathname /$HADOOP_HOME/build/test/data/jip-testing from $HADOOP_HOME/build/test/data/jip-testing is not a valid DFS filename.

    * org.apache.hadoop.cli.TestCLI.testAll - log attached

    * org.apache.hadoop.hdfs.TestHDFSServerPorts.testNameNodePorts, org.apache.hadoop.hdfs.TestHDFSServerPorts.testDataNodePorts, org.apache.hadoop.hdfs.TestHDFSServerPorts.testSecondaryNodePorts - log attached

    * org.apache.hadoop.mapred.TestJobQueueInformation.testJobQueues
    Stacktrace:
    java.lang.IllegalArgumentException: Pathname /$HADOOP_HOME/build/test/data/job-queue-info-testing/share from $HADOOP_HOME/build/test/data/job-queue-info-testing/share is not a valid DFS filename.

    * org.apache.hadoop.mapred.TestMRServerPorts.testJobTrackerPorts, org.apache.hadoop.mapred.TestMRServerPorts.testTaskTrackerPorts - log attached

    * org.apache.hadoop.mapred.TestMiniMRDFSCaching.testWithDFS - log attached
    Stacktrace:
    junit.framework.AssertionFailedError: Archives not matching at org.apache.hadoop.mapred.TestMiniMRDFSCaching.testWithDFS(TestMiniMRDFSCaching.java:60)

    * org.apache.hadoop.mapred.TestMiniMRLocalFS.testWithLocal - log attached
    Stacktrace:
    java.io.IOException: Job failed!

    * org.apache.hadoop.mapreduce.TestMapReduceLocal.testWithLocal
    Stacktrace:
    org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory $HADOOP_HOME/build/test/data/out already exists

    * org.apache.hadoop.security.authorize.TestServiceLevelAuthorization.testRefresh
    Stacktrace:
    org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.security.authorize.AuthorizationException: java.security.AccessControlException: access denied ConnectionPermission(org.apache.hadoop.security.authorize.RefreshAuthorizationPolicyProtocol)

    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ramya R (JIRA) at Jan 30, 2009 at 4:27 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Ramya R updated HADOOP-5114:
    ----------------------------

    Attachment: LOGS.zip

    I have zipped all the logs and attached it. Sorry, could not find a better way to do it.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Nigel Daley (JIRA) at Jan 30, 2009 at 8:09 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Nigel Daley updated HADOOP-5114:
    --------------------------------

    Affects Version/s: (was: 0.18.3)
    0.18.4
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.4
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.3

    Attachments: HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Nigel Daley (JIRA) at Jan 30, 2009 at 8:13 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Nigel Daley updated HADOOP-5114:
    --------------------------------

    Affects Version/s: (was: 0.18.4)
    0.18.3
    Fix Version/s: (was: 0.18.3)
    0.18.4
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 30, 2009 at 11:01 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12669070#action_12669070 ]

    Raghu Angadi commented on HADOOP-5114:
    --------------------------------------

    bq. I still want to check why exactly is the timeout for accept() required.

    It looks like the timeout for accept is not required (tested on Linux). The problem was that offerService() thread waits on DataXCeiver thread before calling shutdown. We should just move the 'join' into shutdown().

    will check the simple fix on Windows. Not that TestDiskError fails anyway later (for a different reason, HADOOP-2023), but I just want to make sure that DataNode actually exits in case of real error.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 30, 2009 at 11:01 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12669070#action_12669070 ]

    rangadi edited comment on HADOOP-5114 at 1/30/09 3:01 PM:
    ---------------------------------------------------------------

    bq. I still want to check why exactly is the timeout for accept() required.

    It looks like the timeout for accept is not required (tested on Linux). The problem was that offerService() thread waits on DataXCeiver thread before calling shutdown. We should just move the 'join' into shutdown().

    will check the simple fix on Windows. Note that TestDiskError fails anyway later (for a different reason, HADOOP-2023), but I just want to make sure that DataNode actually exits in case of real error.

    was (Author: rangadi):
    bq. I still want to check why exactly is the timeout for accept() required.

    It looks like the timeout for accept is not required (tested on Linux). The problem was that offerService() thread waits on DataXCeiver thread before calling shutdown. We should just move the 'join' into shutdown().

    will check the simple fix on Windows. Not that TestDiskError fails anyway later (for a different reason, HADOOP-2023), but I just want to make sure that DataNode actually exits in case of real error.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Jan 31, 2009 at 1:53 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Attachment: HADOOP-5114.patch

    Simpler patch is attached. It does the the following :

    # Removes the need to for timeout for accept. Just moves the waiting for DataXceiver thread into shutdown()
    ** Also removes the config variable for the timeout.
    ** This does not introduce {{thread.interrupt()}}. It was already there.
    # Disables {{TestDiskError.testShutdown()}} on windows since setting a directory to read only does not prohibit file creation (as the test requires).
    ** This is similar to HADOOP-2023
    ** Though the test is disabled, I made sure that 'shutdown()' actually works as expected on windows.

    My proposal for this Jira :
    * Attached patch fixes the cause for bulk of the tests failing on Windows
    * If the patch looks fine, we can go ahead and commit it.
    * For rest of the failures, we can file separate jira(s) as appropriate.

    I have not yet looked into the other test failures that Ramya reported.

    Btw, the earlier patch that implements a timeout for accept() could be useful in future.

    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hairong Kuang (JIRA) at Feb 3, 2009 at 7:32 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670075#action_12670075 ]

    Hairong Kuang commented on HADOOP-5114:
    ---------------------------------------

    +1. This fix looks good to me. Thanks Raghu for taking care of this jira.

    One related issue. DataXceiverServer#kill() closes all currently opened sockets recorded in childSockets. But newly accepted sockets never get added to childSockets. Should we worry about it?
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 3, 2009 at 7:52 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670082#action_12670082 ]

    Raghu Angadi commented on HADOOP-5114:
    --------------------------------------

    Thanks Hairong.

    Good point regd {{childSockets}}. It does not look like any socket is actually placed in the list. It might have never worked as intended even for normal sockets. It probably needs a separate jira.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 3, 2009 at 7:52 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Status: Patch Available (was: Open)
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hairong Kuang (JIRA) at Feb 3, 2009 at 8:14 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670091#action_12670091 ]

    Hairong Kuang commented on HADOOP-5114:
    ---------------------------------------
    It probably needs a separate jira.
    Created a jira at HADOOP-5161.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 3, 2009 at 11:30 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Attachment: HADOOP-5114-branch-18.patch
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 3, 2009 at 11:30 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Attachment: HADOOP-5114.patch

    attached patch for 0.18 branch.
    reattached earlier trunk patch for Hudson.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Feb 4, 2009 at 6:46 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670259#action_12670259 ]

    Hadoop QA commented on HADOOP-5114:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12399406/HADOOP-5114.patch
    against trunk revision 740532.

    +1 @author. The patch does not contain any @author tags.

    +1 tests included. The patch appears to include 3 new or modified tests.

    +1 javadoc. The javadoc tool did not generate any warning messages.

    +1 javac. The applied patch does not increase the total number of javac compiler warnings.

    -1 findbugs. The patch appears to introduce 1 new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    +1 release audit. The applied patch does not increase the total number of release audit warnings.

    -1 core tests. The patch failed core unit tests.

    -1 contrib tests. The patch failed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3794/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3794/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3794/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3794/console

    This message is automatically generated.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 4, 2009 at 8:04 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Attachment: HADOOP-5114-branch-18.patch
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 4, 2009 at 8:12 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Status: Open (was: Patch Available)
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 4, 2009 at 8:12 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Status: Patch Available (was: Open)
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 4, 2009 at 8:18 pm
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Attachment: HADOOP-5114.patch

    Updated patch fixes the find bugs warning (same change fixes TestHDFSServerPorts as well).

    Regd the test failures in Hudson :
    - {{TestHDFSServerPorts.testDataNodePorts}} : fixed
    - {{TestAgentConfig.testInitAdaptors_vs_Checkpoint} : failed for multiple patches. Needs a jira.
    - {{TestDFSStartupVersions.testVersions}} : seems unrelated and can not reproduce. will check more.

    Local test-patch run : {noformat}
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Feb 5, 2009 at 4:24 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670626#action_12670626 ]

    Hadoop QA commented on HADOOP-5114:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12399480/HADOOP-5114.patch
    against trunk revision 740532.

    +1 @author. The patch does not contain any @author tags.

    +1 tests included. The patch appears to include 3 new or modified tests.

    +1 javadoc. The javadoc tool did not generate any warning messages.

    +1 javac. The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs. The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    +1 release audit. The applied patch does not increase the total number of release audit warnings.

    +1 core tests. The patch passed core unit tests.

    -1 contrib tests. The patch failed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3799/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3799/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3799/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3799/console

    This message is automatically generated.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ramya R (JIRA) at Feb 5, 2009 at 9:06 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Ramya R updated HADOOP-5114:
    ----------------------------

    Attachment: TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt

    I still can see TestOverReplicatedBlocks.testProcesOverReplicateBlock failing due to assertion failure on Windows on 18 branch. Attaching the log.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 6, 2009 at 12:14 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Status: Open (was: Patch Available)
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 6, 2009 at 12:14 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Status: Patch Available (was: Open)
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 6, 2009 at 1:00 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Attachment: HADOOP-5114-branch-18.patch
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 6, 2009 at 1:02 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Attachment: HADOOP-5114.patch


    Thanks Ramya. The latest patch fixes TestOverReplicatedBlock.java. This test was added recently by HADOOP-4910.



    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Feb 6, 2009 at 1:12 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670970#action_12670970 ]

    Hadoop QA commented on HADOOP-5114:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12399537/TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt
    against trunk revision 741330.

    +1 @author. The patch does not contain any @author tags.

    -1 tests included. The patch doesn't appear to include any new or modified tests.
    Please justify why no tests are needed for this patch.

    -1 patch. The patch command could not apply the patch.

    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3803/console

    This message is automatically generated.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 6, 2009 at 1:18 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Status: Patch Available (was: Open)
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Feb 6, 2009 at 1:18 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Raghu Angadi updated HADOOP-5114:
    ---------------------------------

    Status: Open (was: Patch Available)
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Feb 6, 2009 at 5:28 am
    [ https://issues.apache.org/jira/browse/HADOOP-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12671008#action_12671008 ]

    Hadoop QA commented on HADOOP-5114:
    -----------------------------------

    +1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12399609/HADOOP-5114.patch
    against trunk revision 741330.

    +1 @author. The patch does not contain any @author tags.

    +1 tests included. The patch appears to include 9 new or modified tests.

    +1 javadoc. The javadoc tool did not generate any warning messages.

    +1 javac. The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs. The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    +1 release audit. The applied patch does not increase the total number of release audit warnings.

    +1 core tests. The patch passed core unit tests.

    +1 contrib tests. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3804/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3804/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3804/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3804/console

    This message is automatically generated.
    A bunch of mapred unit tests are failing on Windows
    ---------------------------------------------------

    Key: HADOOP-5114
    URL: https://issues.apache.org/jira/browse/HADOOP-5114
    Project: Hadoop Core
    Issue Type: Test
    Components: mapred, test
    Affects Versions: 0.18.3
    Environment: Windows
    Reporter: Ramya R
    Assignee: Raghu Angadi
    Priority: Minor
    Fix For: 0.18.4

    Attachments: HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114-branch-18.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, HADOOP-5114.patch, LOGS.zip, TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt, tmp.log


    A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:
    Exception: "java.net.ConnectException: Connection refused: no further information"
    Failing tests:
    * TestMiniMRMapRedDebugScript - testMapDebugScript
    * TestNoDefaultsJobConf - testNoDefaults
    * TestQueueManager - testAllEnabledACLForJobSubmission
    * TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
    * TestJobInProgressListener - testJobQueueChanges
    * TestKillCompletedJob - testKillCompJob
    * TestMiniMRClasspath - testClassPath
    * TestMiniMRDFSCaching - testWithDFS
    * TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
    * TestSetupAndCleanupFailure - testWithDFS
    * TestDBJob - testRun
    * TestMiniMRWithDFS - testWithDFS
    * TestJobStatusPersistency - testNonPersistency
    * TestSpecialCharactersInOutputPath - testJobWithDFS
    * TestUserDefinedCounters - testMapReduceJob
    * TestDelegatingInputFormat - testSplitting
    * TestEmptyJobWithDFS - testEmptyJobWithDFS
    * TestJavaSerialization - testMapReduceJob
    * TestClusterMapReduceTestCase - testMapReduce
    Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
    Failing tests:
    * TestJobInProgress - testRunningTaskCount
    * TestJobQueueInformation - testJobQueues
    * TestJobTrackerRestart - testJobTrackerRestart
    Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
    Failing tests:
    * TestJobSysDirWithDFS - testWithDFS
    * TestJobInProgress - testPendingMapTaskCount
    * TestMiniMRDFSSort - testMapReduceSort
    Exception: junit.framework.AssertionFailedError
    Failing tests:
    * TestMRServerPorts - testJobTrackerPorts
    * TestMRServerPorts - testTaskTrackerPorts
    * TestMiniMRTaskTempDir - testTaskTempDir
    Exception: java.io.IOException: Job failed!
    Failing tests:
    * TestMiniMRLocalFS - testWithLocal
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJan 23, '09 at 8:09a
activeFeb 16, '09 at 5:04p
posts56
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 56 posts

People

Translate

site design / logo © 2022 Grokbase