FAQ
So I ^C a job from the command line and get my prompt back, but sometimes the job remains on the cluster, I can see it on the admin web UI, and sometimes it lingers there for hours before finally getting flushed.

Is there a way to kill a hadoop job once the command line prompt has returned, once the local process has basically ended?

________________________________________________________________________________
Keith Wiley kwiley@keithwiley.com www.keithwiley.com

"And what if we picked the wrong religion? Every week, we're just making God
madder and madder!"
-- Homer Simpson
________________________________________________________________________________

Search Discussions

  • Edward Capriolo at Apr 12, 2010 at 5:23 pm

    On Mon, Apr 12, 2010 at 1:17 PM, Keith Wiley wrote:

    So I ^C a job from the command line and get my prompt back, but sometimes
    the job remains on the cluster, I can see it on the admin web UI, and
    sometimes it lingers there for hours before finally getting flushed.

    Is there a way to kill a hadoop job once the command line prompt has
    returned, once the local process has basically ended?


    ________________________________________________________________________________
    Keith Wiley kwiley@keithwiley.com
    www.keithwiley.com

    "And what if we picked the wrong religion? Every week, we're just making
    God
    madder and madder!"
    -- Homer Simpson

    ________________________________________________________________________________



    Get the job id with:
    hadoop job -list

    Kill it with:
    hadoop job -kill <id>
  • Keith Wiley at Apr 12, 2010 at 6:12 pm

    On Apr 12, 2010, at 10:22 , Edward Capriolo wrote:
    On Mon, Apr 12, 2010 at 1:17 PM, Keith Wiley wrote:

    So I ^C a job from the command line and get my prompt back, but sometimes
    the job remains on the cluster, I can see it on the admin web UI, and
    sometimes it lingers there for hours before finally getting flushed.

    Is there a way to kill a hadoop job once the command line prompt has
    returned, once the local process has basically ended?

    Get the job id with:
    hadoop job -list

    Kill it with:
    hadoop job -kill <id>
    Thanks. Works like a charm.

    ________________________________________________________________________________
    Keith Wiley kwiley@keithwiley.com www.keithwiley.com

    "Luminous beings are we, not this crude matter."
    -- Yoda
    ________________________________________________________________________________
  • Keith Wiley at Apr 12, 2010 at 6:07 pm
    Update: on another mailing list it was shown how to use the hadoop binary with the 'jobs -kill' command to kill a job.
    On Apr 12, 2010, at 10:17 , Keith Wiley wrote:

    So I ^C a job from the command line and get my prompt back, but sometimes the job remains on the cluster, I can see it on the admin web UI, and sometimes it lingers there for hours before finally getting flushed.

    Is there a way to kill a hadoop job once the command line prompt has returned, once the local process has basically ended?

    ________________________________________________________________________________
    Keith Wiley kwiley@keithwiley.com www.keithwiley.com

    "And what if we picked the wrong religion? Every week, we're just making God
    madder and madder!"
    -- Homer Simpson
    ________________________________________________________________________________


    ________________________________________________________________________________
    Keith Wiley kwiley@keithwiley.com www.keithwiley.com

    "What I primarily learned in grad school is how much I *don't* know.
    Consequently, I left grad school with a higher ignorance to knowledge ratio than
    when I entered."
    -- Keith Wiley
    ________________________________________________________________________________

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedApr 12, '10 at 5:17p
activeApr 12, '10 at 6:12p
posts4
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Keith Wiley: 3 posts Edward Capriolo: 1 post

People

Translate

site design / logo © 2022 Grokbase