FAQ
Unit test TestMiniMRDFSSort.testMapReduceSort fails on windows with a timeout
-----------------------------------------------------------------------------

Key: HADOOP-3650
URL: https://issues.apache.org/jira/browse/HADOOP-3650
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.19.0
Environment: windows
Reporter: Mukund Madhugiri
Priority: Critical


Unit test TestMiniMRDFSSort.testMapReduceSort fails on windows with a timeout

I see this on the console:
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:19,435 WARN mapred.ReduceTask (ReduceTask.java:run(928)) - attempt_200806252017_0003_r_000000_0 copy failed: attempt_200806252017_0003_m_000002_0 from localhost
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:19,435 WARN mapred.ReduceTask (ReduceTask.java:run(930)) - java.net.SocketTimeoutException: Read timed out
[junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
[junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
[junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
[junit] attempt_200806252017_0003_r_000000_0: at java.lang.reflect.Constructor.newInstance(Constructor.java:494)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1225)
[junit] attempt_200806252017_0003_r_000000_0: at java.security.AccessController.doPrivileged(Native Method)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1219)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:906)
[junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1217)
[junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1067)
[junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:976)
[junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:925)
[junit] attempt_200806252017_0003_r_000000_0: Caused by: java.net.SocketTimeoutException: Read timed out
[junit] attempt_200806252017_0003_r_000000_0: at java.net.SocketInputStream.socketRead0(Native Method)
[junit] attempt_200806252017_0003_r_000000_0: at java.net.SocketInputStream.read(SocketInputStream.java:129)
[junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
[junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
[junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.read(BufferedInputStream.java:313)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:681)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:626)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:957)
[junit] attempt_200806252017_0003_r_000000_0: ... 4 more
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1564)) - Task attempt_200806252017_0003_r_000000_0: Failed fetch #2 from attempt_200806252017_0003_m_000002_0
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1575)) - Failed to fetch map-output from attempt_200806252017_0003_m_000002_0 even after MAX_FETCH_RETRIES_PER_MAP retries... reporting to the JobTracker
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 WARN mapred.ReduceTask (ReduceTask.java:fetchOutputs(1636)) - attempt_200806252017_0003_r_000000_0 adding host localhost to penalty box, next contact in 8 seconds
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:21,201 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1427)) - attempt_200806252017_0003_r_000000_0: Got 5 map-outputs from previous failures
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:31,216 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1486)) - attempt_200806252017_0003_r_000000_0 Scheduled 1 of 5 known outputs (0 slow hosts and 4 dup hosts)
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:08,482 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1390)) - attempt_200806252017_0003_r_000000_0 Need another 20 map output(s) where 1 is already in progress
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:09,451 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1413)) - attempt_200806252017_0003_r_000000_0: Got 0 new map-outputs & number of known map outputs is 4
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:09,451 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1486)) - attempt_200806252017_0003_r_000000_0 Scheduled 0 of 4 known outputs (0 slow hosts and 4 dup hosts)
[junit] 2008-06-25 20:31:00,779 INFO mapred.JobClient (JobClient.java:runJob(1037)) - Task Id : attempt_200806252017_0003_m_000002_0, Status : KILLED



--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Ramya R (JIRA) at Nov 10, 2008 at 9:05 am
    [ https://issues.apache.org/jira/browse/HADOOP-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Ramya R resolved HADOOP-3650.
    -----------------------------

    Resolution: Cannot Reproduce

    Cannot be reproduced. Hence closing the issue.
    Unit test TestMiniMRDFSSort.testMapReduceSort fails on windows with a timeout
    -----------------------------------------------------------------------------

    Key: HADOOP-3650
    URL: https://issues.apache.org/jira/browse/HADOOP-3650
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.19.0
    Environment: windows
    Reporter: Mukund Madhugiri
    Priority: Critical

    Unit test TestMiniMRDFSSort.testMapReduceSort fails on windows with a timeout
    I see this on the console:
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:19,435 WARN mapred.ReduceTask (ReduceTask.java:run(928)) - attempt_200806252017_0003_r_000000_0 copy failed: attempt_200806252017_0003_m_000002_0 from localhost
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:19,435 WARN mapred.ReduceTask (ReduceTask.java:run(930)) - java.net.SocketTimeoutException: Read timed out
    [junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    [junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
    [junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
    [junit] attempt_200806252017_0003_r_000000_0: at java.lang.reflect.Constructor.newInstance(Constructor.java:494)
    [junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1225)
    [junit] attempt_200806252017_0003_r_000000_0: at java.security.AccessController.doPrivileged(Native Method)
    [junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1219)
    [junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:906)
    [junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1217)
    [junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1067)
    [junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:976)
    [junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:925)
    [junit] attempt_200806252017_0003_r_000000_0: Caused by: java.net.SocketTimeoutException: Read timed out
    [junit] attempt_200806252017_0003_r_000000_0: at java.net.SocketInputStream.socketRead0(Native Method)
    [junit] attempt_200806252017_0003_r_000000_0: at java.net.SocketInputStream.read(SocketInputStream.java:129)
    [junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
    [junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    [junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.read(BufferedInputStream.java:313)
    [junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:681)
    [junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:626)
    [junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:957)
    [junit] attempt_200806252017_0003_r_000000_0: ... 4 more
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1564)) - Task attempt_200806252017_0003_r_000000_0: Failed fetch #2 from attempt_200806252017_0003_m_000002_0
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1575)) - Failed to fetch map-output from attempt_200806252017_0003_m_000002_0 even after MAX_FETCH_RETRIES_PER_MAP retries... reporting to the JobTracker
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 WARN mapred.ReduceTask (ReduceTask.java:fetchOutputs(1636)) - attempt_200806252017_0003_r_000000_0 adding host localhost to penalty box, next contact in 8 seconds
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:21,201 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1427)) - attempt_200806252017_0003_r_000000_0: Got 5 map-outputs from previous failures
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:31,216 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1486)) - attempt_200806252017_0003_r_000000_0 Scheduled 1 of 5 known outputs (0 slow hosts and 4 dup hosts)
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:08,482 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1390)) - attempt_200806252017_0003_r_000000_0 Need another 20 map output(s) where 1 is already in progress
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:09,451 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1413)) - attempt_200806252017_0003_r_000000_0: Got 0 new map-outputs & number of known map outputs is 4
    [junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:09,451 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1486)) - attempt_200806252017_0003_r_000000_0 Scheduled 0 of 4 known outputs (0 slow hosts and 4 dup hosts)
    [junit] 2008-06-25 20:31:00,779 INFO mapred.JobClient (JobClient.java:runJob(1037)) - Task Id : attempt_200806252017_0003_m_000002_0, Status : KILLED
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJun 26, '08 at 6:24p
activeNov 10, '08 at 9:05a
posts2
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Ramya R (JIRA): 2 posts

People

Translate

site design / logo © 2022 Grokbase