FAQ
Hello users,

Hi all,

I have a hadoop setup using cloudera manager. How can I use "hadoop job
-history" command ?

I can see the logs directory in "/var/log/hadoop/history/done"

But how can I use "hadoop job -history" command to view it on terminal.
When I am running "hadoop job -history" -- I am getting the following error:

hadoop job -history /var/log/hadoop/history/done/ Exception in thread
"main" java.io.IOException: Not able to initialize History viewer

       at
org.apache.hadoop.mapred.HistoryViewer.(JobClient.java:1831)

       at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)

       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)

       at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)

Caused by: java.io.IOException: History directory
/var/log/hadoop/history/done/_logs/historydoes not exist

       at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)

       ... 5 more
Regards,
Praveenesh

Search Discussions

  • Joey Echeverria at Aug 27, 2012 at 11:01 am
    What version of CM are you using?

    It looks like you didn't deploy the client configs to the machine where you're running the Hadoop command.

    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.

    On Monday, August 27, 2012 at 5:35, praveenesh kumar wrote:


    Hello users,

    Hi all,

    I have a hadoop setup using cloudera manager. How can I use "hadoop job -history" command ?

    I can see the logs directory in "/var/log/hadoop/history/done"

    But how can I use "hadoop job -history" command to view it on terminal. When I am running "hadoop job -history" -- I am getting the following error:

    hadoop job -history /var/log/hadoop/history/done/ Exception in thread "main" java.io.IOException: Not able to initialize History viewer
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)
    at org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)
    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)
    Caused by: java.io.IOException: History directory /var/log/hadoop/history/done/_logs/historydoes not exist
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)
    ... 5 more
    Regards,
    Praveenesh
  • Praveenesh kumar at Aug 27, 2012 at 10:59 am
    I am using CM 4.0.3 (free edition)

    What do you mean by deploying client configs ? I am able to run all hadoop
    MR codes.

    Regards,
    Praveenesh
    On Mon, Aug 27, 2012 at 4:25 PM, Joey Echeverria wrote:

    What version of CM are you using?

    It looks like you didn't deploy the client configs to the machine where
    you're running the Hadoop command.

    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.

    On Monday, August 27, 2012 at 5:35, praveenesh kumar wrote:


    Hello users,

    Hi all,

    I have a hadoop setup using cloudera manager. How can I use "hadoop job
    -history" command ?

    I can see the logs directory in "/var/log/hadoop/history/done"

    But how can I use "hadoop job -history" command to view it on terminal.
    When I am running "hadoop job -history" -- I am getting the following error:

    hadoop job -history /var/log/hadoop/history/done/ Exception in thread
    "main" java.io.IOException: Not able to initialize History viewer

    at
    org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)

    at
    org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)

    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)

    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)

    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)

    Caused by: java.io.IOException: History directory
    /var/log/hadoop/history/done/_logs/historydoes not exist

    at
    org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)

    ... 5 more
    Regards,
    Praveenesh

  • Joey Echeverria at Aug 27, 2012 at 11:03 am
    Can you post a link to your mapred-site.xml file on that box?

    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.

    On Monday, August 27, 2012 at 6:59, praveenesh kumar wrote:

    I am using CM 4.0.3 (free edition)

    What do you mean by deploying client configs ? I am able to run all hadoop MR codes.

    Regards,
    Praveenesh
    On Mon, Aug 27, 2012 at 4:25 PM, Joey Echeverria (mailto:joey@cloudera.com)> wrote:
    What version of CM are you using?

    It looks like you didn't deploy the client configs to the machine where you're running the Hadoop command.

    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.

    On Monday, August 27, 2012 at 5:35, praveenesh kumar wrote:


    Hello users,

    Hi all,

    I have a hadoop setup using cloudera manager. How can I use "hadoop job -history" command ?

    I can see the logs directory in "/var/log/hadoop/history/done"

    But how can I use "hadoop job -history" command to view it on terminal. When I am running "hadoop job -history" -- I am getting the following error:

    hadoop job -history /var/log/hadoop/history/done/ Exception in thread "main" java.io.IOException: Not able to initialize History viewer
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)
    at org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)
    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)
    Caused by: java.io.IOException: History directory /var/log/hadoop/history/done/_logs/historydoes not exist
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)
    ... 5 more
    Regards,
    Praveenesh
  • Praveenesh kumar at Aug 27, 2012 at 11:19 am
    I can't see any link to mapred-site.xml. However, I can see "Deploy client
    configuration" in my Actions for mapreduce. I did that also, still I don't
    see any mapred-site.xml link. What am I missing or doing wrong ?

    Regards,
    Praveenesh
    On Monday, August 27, 2012 3:05:37 PM UTC+5:30, praveenesh kumar wrote:


    Hello users,

    Hi all,

    I have a hadoop setup using cloudera manager. How can I use "hadoop job
    -history" command ?

    I can see the logs directory in "/var/log/hadoop/history/done"

    But how can I use "hadoop job -history" command to view it on terminal.
    When I am running "hadoop job -history" -- I am getting the following error:

    hadoop job -history /var/log/hadoop/history/done/ Exception in thread
    "main" java.io.IOException: Not able to initialize History viewer

    at
    org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)

    at
    org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)

    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)

    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)

    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)

    Caused by: java.io.IOException: History directory
    /var/log/hadoop/history/done/_logs/historydoes not exist

    at
    org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)

    ... 5 more
    Regards,
    Praveenesh
  • Praveenesh kumar at Aug 27, 2012 at 11:34 am
    Okay.. so on Jobtracker page.. I can see the link to all my configuration
    files including mapred-site.xml..
    So It looks like client configs are deployed.

    Regards,
    Praveenesh
    On Monday, August 27, 2012 3:05:37 PM UTC+5:30, praveenesh kumar wrote:


    Hello users,

    Hi all,

    I have a hadoop setup using cloudera manager. How can I use "hadoop job
    -history" command ?

    I can see the logs directory in "/var/log/hadoop/history/done"

    But how can I use "hadoop job -history" command to view it on terminal.
    When I am running "hadoop job -history" -- I am getting the following error:

    hadoop job -history /var/log/hadoop/history/done/ Exception in thread
    "main" java.io.IOException: Not able to initialize History viewer

    at
    org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)

    at
    org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)

    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)

    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)

    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)

    Caused by: java.io.IOException: History directory
    /var/log/hadoop/history/done/_logs/historydoes not exist

    at
    org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)

    ... 5 more
    Regards,
    Praveenesh

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedAug 27, '12 at 9:35a
activeAug 27, '12 at 11:34a
posts6
users2
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase