FAQ
I am trying to to distcp lots of small files from on HDFS to another. But
even after specifying number of mappers = 200 by option -m 200 distcp is
starting only 1 map job.
Average file size is less than 100mb.

Is there any way to start more mappers.
I have tried -m option.

Thanks,
-
Ravi

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedJan 25, '11 at 11:14p
activeJan 25, '11 at 11:14p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Ravi Phulari: 1 post

People

Translate

site design / logo © 2022 Grokbase