FAQ
Hello all,

The cluster has a capacity of 28 concurrent mappers. It looks like on larger
tables Hive will use all 28 mappers, but on a smaller table it only uses 4
mappers maximum. Any idea how to override this?

Thanks,
Ryan

Search Discussions

  • Zheng Shao at Dec 11, 2009 at 12:26 am
    Try this:
    set mapred.map.tasks=28;

    Zheng
    From: Ryan LeCompte
    Sent: Thursday, December 10, 2009 1:45 PM
    To: hive-user@hadoop.apache.org
    Subject: Hive not using the full mapper capacity for certain jobs

    Hello all,

    The cluster has a capacity of 28 concurrent mappers. It looks like on larger tables Hive will use all 28 mappers, but on a smaller table it only uses 4 mappers maximum. Any idea how to override this?

    Thanks,
    Ryan

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedDec 10, '09 at 9:45p
activeDec 11, '09 at 12:26a
posts2
users2
websitehive.apache.org

2 users in discussion

Ryan LeCompte: 1 post Zheng Shao: 1 post

People

Translate

site design / logo © 2022 Grokbase