FAQ
hadoop should handle no cygwin on windows more gracefully
---------------------------------------------------------

Key: HADOOP-3839
URL: https://issues.apache.org/jira/browse/HADOOP-3839
Project: Hadoop Core
Issue Type: Improvement
Environment: Windows XP, cygwin not installed
Reporter: Steve Loughran
Priority: Minor


There have been a couple of postings to hadoop core-user in which people can't get hdfs to come up on windows because whoami isnt on the path, which fails with an IOException error code 2.

To people not experienced in DOS error codes, this is a fairly meanless number which invariably leads to time wasted and support emails.

1. the error could be caught and handled by printing some better hints (point to a wiki page?)
2. is whoami really needed on DOS-based filesystems?



--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Steve Loughran (JIRA) at Jul 26, 2008 at 1:59 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617176#action_12617176 ]

    Steve Loughran commented on HADOOP-3839:
    ----------------------------------------

    stack trace from the mailing list



    INFO: initializing HDFS with config Configuration: hadoop-default.xml,
    hadoop-site.xml,
    file:/C:/w/hadoop-test/./conf/roy-client/hadoop-default.xml,
    file:/C:/w/hadoop-test/./conf/roy-client/hadoop-site.xml
    08/07/15 18:36:08 WARN fs.FileSystem: uri=hdfs://roy:9000
    javax.security.auth.login.LoginException: Login failed: CreateProcess:
    whoami error=2
    at
    org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
    at
    org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
    at
    org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:257)
    at
    org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformation.java:67)
    at org.apache.hadoop.fs.FileSystem$Cache$Key.(FileSystem.java:1289)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
    at com.signal7.hadooptest.HadoopTest.getStorageSystem(HadoopTest.java:93)
    at com.signal7.hadooptest.HadoopTest.main(HadoopTest.java:31)
    Exception in thread "main" java.io.IOException
    at org.apache.hadoop.dfs.DFSClient.(DistributedFileSystem.java:68)
    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1280)
    at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:56)
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1291)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
    at com.signal7.hadooptest.HadoopTest.getStorageSystem(HadoopTest.java:93)
    at com.signal7.hadooptest.HadoopTest.main(HadoopTest.java:31)
    Caused by: javax.security.auth.login.LoginException: Login failed:
    CreateProcess: whoami error=2
    at
    org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
    at
    org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
    at org.apache.hadoop.dfs.DFSClient.<init>(DFSClient.java:173)
    ... 8 more
    hadoop should handle no cygwin on windows more gracefully
    ---------------------------------------------------------

    Key: HADOOP-3839
    URL: https://issues.apache.org/jira/browse/HADOOP-3839
    Project: Hadoop Core
    Issue Type: Improvement
    Environment: Windows XP, cygwin not installed
    Reporter: Steve Loughran
    Priority: Minor

    There have been a couple of postings to hadoop core-user in which people can't get hdfs to come up on windows because whoami isnt on the path, which fails with an IOException error code 2.
    To people not experienced in DOS error codes, this is a fairly meanless number which invariably leads to time wasted and support emails.
    1. the error could be caught and handled by printing some better hints (point to a wiki page?)
    2. is whoami really needed on DOS-based filesystems?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Doug Cutting (JIRA) at Jul 28, 2008 at 6:25 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617500#action_12617500 ]

    Doug Cutting commented on HADOOP-3839:
    --------------------------------------

    There are periodic requests to remove Hadoop's cygwin requirements, e.g., to convert Hadoop's shell scripts to batch files. The problem is that most Hadoop developers develop only on Linux, so that, if direct support for Windows is added, it will not likely be well maintained, and will result in more bug reports, not less.
    is whoami really needed on DOS-based filesystems?
    It's not just whoami. There are a number of places where Hadoop depends on having standard unix command line utilities, as well as shell scripting. It seems like perhaps 'whoami' is the just the first one that folks encounter currently.

    Perhaps we should add a test somewhere that, when running on Windows, explicitly checks for cygwin and throws an exception if it's not present. The bin/hadoop script is an obvious place to put it, but that would not have caught this case, where someone is running unit tests.

    hadoop should handle no cygwin on windows more gracefully
    ---------------------------------------------------------

    Key: HADOOP-3839
    URL: https://issues.apache.org/jira/browse/HADOOP-3839
    Project: Hadoop Core
    Issue Type: Improvement
    Environment: Windows XP, cygwin not installed
    Reporter: Steve Loughran
    Priority: Minor

    There have been a couple of postings to hadoop core-user in which people can't get hdfs to come up on windows because whoami isnt on the path, which fails with an IOException error code 2.
    To people not experienced in DOS error codes, this is a fairly meanless number which invariably leads to time wasted and support emails.
    1. the error could be caught and handled by printing some better hints (point to a wiki page?)
    2. is whoami really needed on DOS-based filesystems?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Steve Loughran (JIRA) at Jul 28, 2008 at 10:35 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617600#action_12617600 ]

    Steve Loughran commented on HADOOP-3839:
    ----------------------------------------

    I've seen the other places where cygwin is used (e.g file permission checks), and it does make sense -at least for the servers. I'm not so convinced it needs to be mandatory client side.

    A check fror cygwin would be good...one option is just to handle that failure we see in the stack trace, and encode the knowledge that if whoami fails with error code=2 on windows, somebody probably hasn't got cygwin installed, or its path set up correctly.
    hadoop should handle no cygwin on windows more gracefully
    ---------------------------------------------------------

    Key: HADOOP-3839
    URL: https://issues.apache.org/jira/browse/HADOOP-3839
    Project: Hadoop Core
    Issue Type: Improvement
    Environment: Windows XP, cygwin not installed
    Reporter: Steve Loughran
    Priority: Minor

    There have been a couple of postings to hadoop core-user in which people can't get hdfs to come up on windows because whoami isnt on the path, which fails with an IOException error code 2.
    To people not experienced in DOS error codes, this is a fairly meanless number which invariably leads to time wasted and support emails.
    1. the error could be caught and handled by printing some better hints (point to a wiki page?)
    2. is whoami really needed on DOS-based filesystems?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJul 26, '08 at 1:59p
activeJul 28, '08 at 10:35p
posts4
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Steve Loughran (JIRA): 4 posts

People

Translate

site design / logo © 2022 Grokbase