|| at Feb 13, 2009 at 9:11 am
Linux kernel provides delay accounting information through a netlink
socket to user space. You can read more about it here:http://www.mjmwired.net/kernel/Documentation/accounting/taskstats.txt.
I think there's a python tool called iotop that uses this feature.
Hope this helps.
On Fri, Feb 13, 2009 at 2:40 AM, Bryan Duxbury wrote:
Does anyone have any experience trying to measure IO time spent in their
map/reduce jobs? I know how to profile a sample of map and reduce tasks, but
that appears to exclude IO time. Just subtracting the total cpu time from
the total run time of a task seems like too coarse an approach.