FAQ
All,
Matt rolled a 0.20.204.0rc1, but I think it got lost in the previous vote thread. Unfortunately, it had the version as 0.20.204 and didn't update the release notes. I've updated it, run the regression tests and I think we should release it. I've put the tarball up at:

http://people.apache.org/~omalley/hadoop-0.20.204.0-rc2

Please check it out and vote on it.

-- Owen

Search Discussions

  • Allen Wittenauer at Aug 10, 2011 at 9:12 pm

    On Aug 9, 2011, at 8:55 AM, Owen O'Malley wrote:

    All,
    Matt rolled a 0.20.204.0rc1, but I think it got lost in the previous vote thread. Unfortunately, it had the version as 0.20.204 and didn't update the release notes. I've updated it, run the regression tests and I think we should release it. I've put the tarball up at:

    http://people.apache.org/~omalley/hadoop-0.20.204.0-rc2

    Please check it out and vote on it.
    -1 (non-binding)

    https://issues.apache.org/jira/browse/HDFS-2244
  • Allen Wittenauer at Aug 11, 2011 at 12:50 am

    On Aug 9, 2011, at 8:55 AM, Owen O'Malley wrote:

    All,
    Matt rolled a 0.20.204.0rc1, but I think it got lost in the previous vote thread. Unfortunately, it had the version as 0.20.204 and didn't update the release notes. I've updated it, run the regression tests and I think we should release it. I've put the tarball up at:

    http://people.apache.org/~omalley/hadoop-0.20.204.0-rc2

    Please check it out and vote on it.

    After playing with it this afternoon, it would be good if other people did too. I've already talked to Owen about some of the weirdness I'm seeing, but it would be useful to see if other people can independently verify. I'm not going to tell you what they are... but run a sizable job and see if you see anything.... odd. :)
  • Owen O'Malley at Aug 18, 2011 at 7:29 am

    On Aug 9, 2011, at 8:55 AM, Owen O'Malley wrote:

    All,
    Matt rolled a 0.20.204.0rc1, but I think it got lost in the previous vote thread. Unfortunately, it had the version as 0.20.204 and didn't update the release notes. I've updated it, run the regression tests and I think we should release it. I've put the tarball up at:

    http://people.apache.org/~omalley/hadoop-0.20.204.0-rc2
    This vote is still running with no votes other than mine.

    I've tested with and without security on a 60 node cluster and I'm seeing some failures, but not that many. On a terasort with 15,000 maps and 200 reduces, I ran the following cases:

    security + linux task controller : 2 failures (both mr-2651)

    no security + default task controller : 6-7 failures (seems to be a race condition in clean up)

    Even in the no security case, it is only losing 0.05% of the time.

    It isn't perfect, but this is the code that Yahoo is currently running. I think we should release it.

    -- Owen
  • Allen Wittenauer at Aug 18, 2011 at 5:37 pm

    On Aug 18, 2011, at 12:28 AM, Owen O'Malley wrote:

    This vote is still running with no votes other than mine.

    I've tested with and without security on a 60 node cluster and I'm seeing some failures, but not that many. On a terasort with 15,000 maps and 200 reduces, I ran the following cases:

    security + linux task controller : 2 failures (both mr-2651)

    no security + default task controller : 6-7 failures (seems to be a race condition in clean up)

    Even in the no security case, it is only losing 0.05% of the time.
    We're seeing much much higher failure rates. In the 5-10% area. It might very well be because we have more cores/faster boxes.
    It isn't perfect, but this is the code that Yahoo is currently running. I think we should release it.
    Y! can afford the task failures. The rest of us can't. So -1.
  • Jakob Homan at Aug 18, 2011 at 6:36 pm
    This vote is still running with no votes other than mine.
    The vote was started 9 days ago and, if it kept running after Allen's
    vote, it would have ended three days ago with the result of 1-0 to
    release. As such, let's call this release 2Owen3.
  • Mahadev Konar at Aug 18, 2011 at 7:11 pm
    Jokes aside,
    I intend to try it out on a set of 10 nodes or so and see if it works or not. If it works fine (barring a few task failures), I dont see any reason why this cannot be released.

    thanks
    mahadev
    On Aug 18, 2011, at 11:35 AM, Jakob Homan wrote:

    This vote is still running with no votes other than mine.
    The vote was started 9 days ago and, if it kept running after Allen's
    vote, it would have ended three days ago with the result of 1-0 to
    release. As such, let's call this release 2Owen3.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedAug 9, '11 at 3:56p
activeAug 18, '11 at 7:11p
posts7
users4
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase