running "hadoop job -history" command

On Monday, August 27, 2012 at 5:35, praveenesh kumar wrote:


Hello users,

Hi all,

I have a hadoop setup using cloudera manager. How can I use "hadoop job -history" command ?

I can see the logs directory in "/var/log/hadoop/history/done"

But how can I use "hadoop job -history" command to view it on terminal. When I am running "hadoop job -history" -- I am getting the following error:

hadoop job -history /var/log/hadoop/history/done/ Exception in thread "main" java.io.IOException: Not able to initialize History viewer
at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)
at org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)
at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)
Caused by: java.io.IOException: History directory /var/log/hadoop/history/done/_logs/historydoes not exist
at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)
... 5 more
Regards,
Praveenesh

On Mon, Aug 27, 2012 at 4:25 PM, Joey Echeverria wrote:

What version of CM are you using?

It looks like you didn't deploy the client configs to the machine where
you're running the Hadoop command.

--
Joey Echeverria
Principal Solutions Architect
Cloudera, Inc.

On Monday, August 27, 2012 at 5:35, praveenesh kumar wrote:


Hello users,

Hi all,

I have a hadoop setup using cloudera manager. How can I use "hadoop job
-history" command ?

I can see the logs directory in "/var/log/hadoop/history/done"

But how can I use "hadoop job -history" command to view it on terminal.
When I am running "hadoop job -history" -- I am getting the following error:

hadoop job -history /var/log/hadoop/history/done/ Exception in thread
"main" java.io.IOException: Not able to initialize History viewer

at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)

at
org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)

at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)

at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)

Caused by: java.io.IOException: History directory
/var/log/hadoop/history/done/_logs/historydoes not exist

at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)

... 5 more
Regards,
Praveenesh

On Monday, August 27, 2012 at 6:59, praveenesh kumar wrote:

I am using CM 4.0.3 (free edition)

What do you mean by deploying client configs ? I am able to run all hadoop MR codes.

Regards,
Praveenesh

On Monday, August 27, 2012 3:05:37 PM UTC+5:30, praveenesh kumar wrote:


Hello users,

Hi all,

I have a hadoop setup using cloudera manager. How can I use "hadoop job
-history" command ?

I can see the logs directory in "/var/log/hadoop/history/done"

But how can I use "hadoop job -history" command to view it on terminal.
When I am running "hadoop job -history" -- I am getting the following error:

hadoop job -history /var/log/hadoop/history/done/ Exception in thread
"main" java.io.IOException: Not able to initialize History viewer

at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)

at
org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)

at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)

at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)

Caused by: java.io.IOException: History directory
/var/log/hadoop/history/done/_logs/historydoes not exist

at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)

... 5 more
Regards,
Praveenesh

On Monday, August 27, 2012 3:05:37 PM UTC+5:30, praveenesh kumar wrote:


Hello users,

Hi all,

I have a hadoop setup using cloudera manager. How can I use "hadoop job
-history" command ?

I can see the logs directory in "/var/log/hadoop/history/done"

But how can I use "hadoop job -history" command to view it on terminal.
When I am running "hadoop job -history" -- I am getting the following error:

hadoop job -history /var/log/hadoop/history/done/ Exception in thread
"main" java.io.IOException: Not able to initialize History viewer

at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)

at
org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1831)

at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1780)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)

at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2043)

Caused by: java.io.IOException: History directory
/var/log/hadoop/history/done/_logs/historydoes not exist

at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)

... 5 more
Regards,
Praveenesh