Hi Guys !

I want to analyse the completed Job counters like FILE/HDFS BYTES
READ/WRITTEN along with other values like average map/reduce task run time.
I see that Jobtracker GUI has this info but i want to programmatically
retrieve these values instead of manually noting down these values and do
some analysis. Can i do it in a simple/easier way ?
I also see that Cloudera's HUE is good for this but is there anything
equivalent in Hadoop.

Can anyone guide me in this regard ?


Arun

Search Discussions

  • David Rosenstrauch at Dec 14, 2011 at 4:06 pm

    On 12/14/2011 09:39 AM, arun k wrote:
    Hi Guys !

    I want to analyse the completed Job counters like FILE/HDFS BYTES
    READ/WRITTEN along with other values like average map/reduce task run time.
    I see that Jobtracker GUI has this info but i want to programmatically
    retrieve these values instead of manually noting down these values and do
    some analysis. Can i do it in a simple/easier way ?
    I also see that Cloudera's HUE is good for this but is there anything
    equivalent in Hadoop.

    Can anyone guide me in this regard ?


    Arun
    See:

    http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapreduce/Job.html#getCounters%28%29

    DR

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmapreduce-user @
categorieshadoop
postedDec 14, '11 at 2:40p
activeDec 14, '11 at 4:06p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Arun k: 1 post David Rosenstrauch: 1 post

People

Translate

site design / logo © 2022 Grokbase