I'm working a project to collect MapReduce job information on an application
level. For example, a DW ETL process may involves several MapReduce jobs, we
want to have a dashboard to show the progress of those jobs for the specific
JobStatus does not provide all information like JobTracker web
page. JobInProgress is used in JobTracker and JobHistory and it is in
JobTracker memory, and seem not exposed to the client side.
The current method I am using is to check history log files and job conf XML
file to extract those information like jobdetailhistory.jsp and
Is there a better way to collect the information like JobInProgress?