FAQ
Hi Everyone, thanks for your time and knowledge. I'm looking for where Hadoop keeps
cached information on Job Counters, FileSystemCounters, and Map-Reduce Frameworks
metrics. Here's an example.


Counter

Map

Reduce

Total

Job Counters

Rack-local map tasks





1

Launched map tasks





1



FileSystemCounters

HDFS_BYTES_READ

5,420,676



5,420,676

HDFS_BYTES_WRITTEN

155,445,341



155,445,341



Map-Reduce Framework

Map input records

515,486



515,486

Spilled Records









Map input bytes

5,373,665



5,373,665



Map output records

515,486



515,486





I'm trying to calculate io.sort.record.percent by greping the cache files for finished
jobs.

Thanks,
Matt

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedJun 17, '10 at 11:11p
activeJun 17, '10 at 11:11p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Matias Silva: 1 post

People

Translate

site design / logo © 2022 Grokbase