FAQ
[ https://issues.apache.org/jira/browse/HADOOP-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12565595#action_12565595 ]

Mahadev konar commented on HADOOP-1792:
---------------------------------------

looks like this has been fixed and works with cygwin as intended. resolving for now.
df command doesn't exist under windows
--------------------------------------

Key: HADOOP-1792
URL: https://issues.apache.org/jira/browse/HADOOP-1792
Project: Hadoop Core
Issue Type: Bug
Components: fs
Affects Versions: 0.14.0
Reporter: Benjamin Francisoud
Assignee: Mahadev konar
Fix For: 0.15.0


My code use to work with previous version of hadoop, I upgraded to 0.14 and now:
java.io.IOException: CreateProcess: df -k "C:\Documents and Settings\Benjamin\Local Settings\Temp\test14906test\mapredLocal" error=2
at java.lang.ProcessImpl.create(Native Method)
at java.lang.ProcessImpl.<init>(Unknown Source)
at java.lang.ProcessImpl.start(Unknown Source)
at java.lang.ProcessBuilder.start(Unknown Source)
at java.lang.Runtime.exec(Unknown Source)
at java.lang.Runtime.exec(Unknown Source)
at org.apache.hadoop.fs.DF.doDF(DF.java:60)
at org.apache.hadoop.fs.DF.<init>(DF.java:53)
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:198)
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:235)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
at org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:88)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpillToDisk(MapTask.java:373)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:593)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:190)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:137)
at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:283)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:397)
...
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Prem Raj (JIRA) at Feb 28, 2008 at 1:33 am
    [ https://issues.apache.org/jira/browse/HADOOP-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573125#action_12573125 ]

    Prem Raj commented on HADOOP-1792:
    ----------------------------------

    I had this problem and the comments here were not very clear. I solved it by trying various things...so here is how I got it to work:

    My environment:
    - Windows XP
    - Eclipse running under Windows
    - Eclipse includes the IBM plugin for mapreduce/hadoop
    - I was trying to run the mapreduce job as a java application via Eclipse

    Solution:
    - Installed the latest stable version of Cygwin
    - Added "c:\Cygwin\bin " (or equivalent) to Path on windows
    - Started the Cygwin shell
    - Ran the mapreduce job as a java application while the Cygwin shell was running.

    Hope this helps clarify things for other newbies.
    df command doesn't exist under windows
    --------------------------------------

    Key: HADOOP-1792
    URL: https://issues.apache.org/jira/browse/HADOOP-1792
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Affects Versions: 0.14.0
    Reporter: Benjamin Francisoud
    Assignee: Mahadev konar
    Fix For: 0.15.0


    My code use to work with previous version of hadoop, I upgraded to 0.14 and now:
    java.io.IOException: CreateProcess: df -k "C:\Documents and Settings\Benjamin\Local Settings\Temp\test14906test\mapredLocal" error=2
    at java.lang.ProcessImpl.create(Native Method)
    at java.lang.ProcessImpl.<init>(Unknown Source)
    at java.lang.ProcessImpl.start(Unknown Source)
    at java.lang.ProcessBuilder.start(Unknown Source)
    at java.lang.Runtime.exec(Unknown Source)
    at java.lang.Runtime.exec(Unknown Source)
    at org.apache.hadoop.fs.DF.doDF(DF.java:60)
    at org.apache.hadoop.fs.DF.<init>(DF.java:53)
    at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:198)
    at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:235)
    at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
    at org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:88)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpillToDisk(MapTask.java:373)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:593)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:190)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:137)
    at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:283)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:397)
    ...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedFeb 4, '08 at 11:17p
activeFeb 28, '08 at 1:33a
posts2
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Prem Raj (JIRA): 2 posts

People

Translate

site design / logo © 2022 Grokbase