FAQ
Has anyone else observed setMaxMapAttempts() not having any effect? I'm still seeing four attempts per mapper task.

________________________________________________________________________________
Keith Wiley kwiley@keithwiley.com www.keithwiley.com

"It's a fine line between meticulous and obsessive-compulsive and a slippery
rope between obsessive-compulsive and debilitatingly slow."
-- Keith Wiley
________________________________________________________________________________

Search Discussions

  • Ted Yu at Nov 5, 2010 at 11:55 pm
    I checked cdh3b2.
    From TaskInProgress:
    private void setMaxTaskAttempts() {
    if (isMapTask()) {
    this.maxTaskAttempts = conf.getMaxMapAttempts();
    } else {

    It should work.
    What hadoop version are you using ?
    On Fri, Nov 5, 2010 at 3:55 PM, Keith Wiley wrote:

    Has anyone else observed setMaxMapAttempts() not having any effect? I'm
    still seeing four attempts per mapper task.


    ________________________________________________________________________________
    Keith Wiley kwiley@keithwiley.com
    www.keithwiley.com

    "It's a fine line between meticulous and obsessive-compulsive and a
    slippery
    rope between obsessive-compulsive and debilitatingly slow."
    -- Keith Wiley

    ________________________________________________________________________________
  • Keith Wiley at Dec 2, 2010 at 6:32 pm
    This still isn't working for me. My line is simply:

    conf.setMaxMapAttempts(1);

    I'm using 0.20.1+152 at the moment. Admittedly, I need to upgrade, but still, shouldn't this work?
    On Nov 5, 2010, at 16:55 , Ted Yu wrote:

    I checked cdh3b2.
    From TaskInProgress:
    private void setMaxTaskAttempts() {
    if (isMapTask()) {
    this.maxTaskAttempts = conf.getMaxMapAttempts();
    } else {

    It should work.
    What hadoop version are you using ?
    On Fri, Nov 5, 2010 at 3:55 PM, Keith Wiley wrote:

    Has anyone else observed setMaxMapAttempts() not having any effect? I'm
    still seeing four attempts per mapper task.

    ________________________________________________________________________________
    Keith Wiley kwiley@keithwiley.com www.keithwiley.com

    "You can scratch an itch, but you can't itch a scratch. Furthermore, an itch can
    itch but a scratch can't scratch. Finally, a scratch can itch, but an itch can't
    scratch. All together this implies: He scratched the itch from the scratch that
    itched but would never itch the scratch from the itch that scratched."
    -- Keith Wiley
    ________________________________________________________________________________

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedNov 5, '10 at 10:55p
activeDec 2, '10 at 6:32p
posts3
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Keith Wiley: 2 posts Ted Yu: 1 post

People

Translate

site design / logo © 2022 Grokbase