FAQ
I have enabled persistent completed jobs status and can see them in HDFS.
However, they are not listed in the jobtracker's UI after the jobtracker is
restarted. I thought that jobtracker will automatically look in HDFS if it
does not find a job in its memory cache. What am I missing? How to I
retrieve the persistent completed job status?

Bill

Search Discussions

  • Amareshwari Sriramadasu at Feb 19, 2009 at 4:01 am

    Bill Au wrote:
    I have enabled persistent completed jobs status and can see them in HDFS.
    However, they are not listed in the jobtracker's UI after the jobtracker is
    restarted. I thought that jobtracker will automatically look in HDFS if it
    does not find a job in its memory cache. What am I missing? How to I
    retrieve the persistent completed job status?

    Bill
    JobTracker web ui doesn't look at persistence storage after a restart.
    You can access the old jobs from job history. History link is accesible
    from web ui.
    -Amareshwari
  • Bill Au at Feb 19, 2009 at 3:21 pm
    The idea behind persistent completed jobs status is that they are still
    available in case of a jobtracker failure, right? The job history is stored
    as files under the log directory on the jobtracker node. So they won't be
    available when the jobtraker node fails. For folks who have enabled this
    feature, how do you retrieve the presistended completed jobs status?

    Bill
    On Wed, Feb 18, 2009 at 10:48 PM, Amareshwari Sriramadasu wrote:

    Bill Au wrote:
    I have enabled persistent completed jobs status and can see them in HDFS.
    However, they are not listed in the jobtracker's UI after the jobtracker
    is
    restarted. I thought that jobtracker will automatically look in HDFS if
    it
    does not find a job in its memory cache. What am I missing? How to I
    retrieve the persistent completed job status?

    Bill

    JobTracker web ui doesn't look at persistence storage after a restart. You
    can access the old jobs from job history. History link is accesible from web
    ui.
    -Amareshwari

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedFeb 18, '09 at 10:05p
activeFeb 19, '09 at 3:21p
posts3
users2
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase