FAQ
HOD should generate hdfs://host:port on the client side configs.
----------------------------------------------------------------

Key: HADOOP-2936
URL: https://issues.apache.org/jira/browse/HADOOP-2936
Project: Hadoop Core
Issue Type: Bug
Components: contrib/hod
Reporter: Mahadev konar
Assignee: Hemanth Yamijala


with hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Mahadev konar (JIRA) at Mar 4, 2008 at 7:01 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mahadev konar updated HADOOP-2936:
    ----------------------------------

    Description: with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings... (was: with hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...)
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Hemanth Yamijala

    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hemanth Yamijala (JIRA) at Mar 6, 2008 at 6:26 am
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12575575#action_12575575 ]

    Hemanth Yamijala commented on HADOOP-2936:
    ------------------------------------------

    Will hdfs://host:port also work with Hadoop 0.16 ?
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Hemanth Yamijala

    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Mahadev konar (JIRA) at Mar 6, 2008 at 6:36 am
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mahadev konar updated HADOOP-2936:
    ----------------------------------

    Fix Version/s: 0.17.0
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Hemanth Yamijala
    Fix For: 0.17.0


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Mahadev konar (JIRA) at Mar 6, 2008 at 6:36 am
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12575581#action_12575581 ]

    Mahadev konar commented on HADOOP-2936:
    ---------------------------------------

    I meant this to be an issue for hadoop 0.17. Would we want HOD in contrib of 0.17 to work with hadoop-0.16? In that case (though I have not tried it) am not sure. need to test it.
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Hemanth Yamijala
    Fix For: 0.17.0


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hemanth Yamijala (JIRA) at Mar 7, 2008 at 5:12 am
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12576039#action_12576039 ]

    Hemanth Yamijala commented on HADOOP-2936:
    ------------------------------------------

    bq. Would we want HOD in contrib of 0.17 to work with hadoop-0.16?

    I don't know currently if it is a requirement. Will check and get back. However, if the answer is a Yes to my question, we don't even have to check. Can you please test it nevertheless ?
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Hemanth Yamijala
    Fix For: 0.17.0


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Mar 14, 2008 at 9:53 am
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Vinod Kumar Vavilapalli updated HADOOP-2936:
    --------------------------------------------

    Attachment: HADOOP-2936

    Attaching a patch. This prepends "hdfs://" to fs.default.name in the hadoop-site.xml generated both on client and server sides. Also verified that the hdfs://host:port format generated works with Hadoop 0.16 too.

    With this patch, client commands no longer print the deprecation message. All, except hadoop jar command which is still doing the same despite changing the fs.default.name to use this URI format. This might be because there are other places in hadoop which are still using the deprecated host:port format instead of the URI format. Another place where I've seen this is hadoop logs pointing to NameNode initialization time.

    The same format fs.default.name is now being generated by HOD not only on JT, TT and client side, but *also* on NN and DN, which seems to work fine, but is that ok, Mahadev?
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Hemanth Yamijala
    Fix For: 0.17.0

    Attachments: HADOOP-2936


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hemanth Yamijala (JIRA) at Mar 16, 2008 at 5:16 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12579202#action_12579202 ]

    Hemanth Yamijala commented on HADOOP-2936:
    ------------------------------------------

    - In hodcleanup, we generate a temporary hadoop-site file for uploading the hadoop logs. The change should reflect here also.
    - We need unit tests for this, as HADOOP-2775 is now committed. *smile*

    Otherwise, patch looks good. I verified it works fine for HADOOP 0.15 as well.

    Can someone please check why hadoop jar prints the warning message on using the deprecated file system URI format, even though fs.default.name is set to hdfs://host:port ?
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Hemanth Yamijala
    Fix For: 0.17.0

    Attachments: HADOOP-2936


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Mar 18, 2008 at 12:47 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Vinod Kumar Vavilapalli updated HADOOP-2936:
    --------------------------------------------

    Assignee: Vinod Kumar Vavilapalli (was: Hemanth Yamijala)
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Mar 19, 2008 at 5:04 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Vinod Kumar Vavilapalli updated HADOOP-2936:
    --------------------------------------------

    Attachment: HADOOP-2936.1

    * Not making the change In hodcleanup since, as part of fix for HADOOP-2899, we are doing away with generating hadoop-site.xml in hodcleanup.
    * Added unittests.

    Submitting the patch.

    Will check why hadoop jar still prints these warning messages.

    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Mar 19, 2008 at 5:10 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Vinod Kumar Vavilapalli updated HADOOP-2936:
    --------------------------------------------

    Affects Version/s: 0.16.0
    Status: Patch Available (was: Open)

    Submitting the patch.
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hemanth Yamijala (JIRA) at Mar 19, 2008 at 5:28 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580461#action_12580461 ]

    Hemanth Yamijala commented on HADOOP-2936:
    ------------------------------------------

    bq. Not making the change In hodcleanup since, as part of fix for HADOOP-2899, we are doing away with generating hadoop-site.xml in hodcleanup.

    ... which I just submitted... *smile*
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hemanth Yamijala (JIRA) at Mar 19, 2008 at 6:00 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580480#action_12580480 ]

    Hemanth Yamijala commented on HADOOP-2936:
    ------------------------------------------

    One small problem. The test cases in testHodRing.py are leaving behind the confdir and logdir directories under /tmp/hod-username/test_HadoopCommand_tempDir. These should be removed.

    Another thing is in testHadoop.py, we don't seem to be using the testingDir variable anywhere. Should we remove it ?

    Otherwise, +1. Functionality is fine. Verified with trunk that the warnings are now gone.
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Mar 20, 2008 at 4:10 am
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580654#action_12580654 ]

    Hadoop QA commented on HADOOP-2936:
    -----------------------------------

    +1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12378252/HADOOP-2936.1
    against trunk revision 619744.

    @author +1. The patch does not contain any @author tags.

    tests included +1. The patch appears to include 8 new or modified tests.

    javadoc +1. The javadoc tool did not generate any warning messages.

    javac +1. The applied patch does not generate any new javac compiler warnings.

    release audit +1. The applied patch does not generate any new release audit warnings.

    findbugs +1. The patch does not introduce any new Findbugs warnings.

    core tests +1. The patch passed core unit tests.

    contrib tests +1. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2005/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2005/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2005/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2005/console

    This message is automatically generated.
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hemanth Yamijala (JIRA) at Mar 20, 2008 at 5:54 am
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580674#action_12580674 ]

    Hemanth Yamijala commented on HADOOP-2936:
    ------------------------------------------

    Given that the functionality is in place, and only the tests need to be slightly changed, we should go ahead with committing. I will file a separate JIRA for changes to the test cases
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Devaraj Das (JIRA) at Mar 20, 2008 at 9:19 am
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Devaraj Das updated HADOOP-2936:
    --------------------------------

    Resolution: Fixed
    Status: Resolved (was: Patch Available)

    I just committed this. Thanks, Vinod!
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Mar 20, 2008 at 1:17 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580754#action_12580754 ]

    Hudson commented on HADOOP-2936:
    --------------------------------

    Integrated in Hadoop-trunk #434 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/434/])
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Mar 21, 2008 at 12:21 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581065#action_12581065 ]

    Hudson commented on HADOOP-2936:
    --------------------------------

    Integrated in Hadoop-trunk #435 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/435/])
    HOD should generate hdfs://host:port on the client side configs.
    ----------------------------------------------------------------

    Key: HADOOP-2936
    URL: https://issues.apache.org/jira/browse/HADOOP-2936
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Mahadev konar
    Assignee: Vinod Kumar Vavilapalli
    Fix For: 0.17.0

    Attachments: HADOOP-2936, HADOOP-2936.1


    with Hadoop-1967, if the fs.default.name is just host:port it prints out warnings when hadoop shell commands are run. Hod should change this to hdfs://host:port so that users do not see these warnings...
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedMar 4, '08 at 7:01p
activeMar 21, '08 at 12:21p
posts18
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 18 posts

People

Translate

site design / logo © 2022 Grokbase