I am running compute intensive job using Hadoop Streaming (hadoop
version 0.19.1), and my mapper input has several thousand small files.
My system has 4 nodes and 8 cores per node.
I want to run 8 mappers per node to use all 8 cores, but whatever the
mapred.map.tasks value is, I can see only two mappers per node (when I
check it using ps -ef|grep mapper_name).
Thank you very much,