FAQ

HADOOP_HEAPSIZE for hive

Koert
Jun 12, 2012 at 3:13 pm
i noticed hive-server sets the heap in /etc/default/hadoop-hive-
server.

if i set HADOOP_HEAPSIZE in /etc/hive/conf/hive-env.sh to a value that
makes sense for hive cli, will this override the setting for hive-
server also? and if so, is there a way to set the default value for
hive cli without affecting hive-server?

i thought about changing the default in /usr/lib/hive/bin/hive-
config.sh (export HADOOP_HEAPSIZE=${HADOOP_HEAPSIZE:-256}), but that
seems like a hack since this file will likely be overwritten by rpm
updates
reply

Search Discussions

2 responses

  • Roman Shaposhnik at Jun 12, 2012 at 3:28 pm

    On Tue, Jun 12, 2012 at 8:12 AM, Koert wrote:
    i noticed hive-server sets the heap in /etc/default/hadoop-hive-
    server.

    if i set HADOOP_HEAPSIZE in /etc/hive/conf/hive-env.sh to a value that
    makes sense for hive cli, will this override the setting for hive-
    server also? and if so, is there a way to set the default value for
    hive cli without affecting hive-server?
    You can try putting the following in your hive-env.sh:
    CLIENT_HEAPSIZE=XXX
    HADOOP_HEAPSIZE=${HADOOP_HEAPSIZE:-$CLIENT_HEAPSIZE}

    Thanks,
    Roman.
  • Koert at Jun 12, 2012 at 5:18 pm
    ah thanks i like that solution!
    On Jun 12, 11:28 am, Roman Shaposhnik wrote:
    On Tue, Jun 12, 2012 at 8:12 AM, Koert wrote:
    i noticed hive-server sets the heap in /etc/default/hadoop-hive-
    server.
    if i set HADOOP_HEAPSIZE in /etc/hive/conf/hive-env.sh to a value that
    makes sense for hive cli, will this override the setting for hive-
    server also? and if so, is there a way to set the default value for
    hive cli without affecting hive-server?
    You can try putting the following in your hive-env.sh:
    CLIENT_HEAPSIZE=XXX
    HADOOP_HEAPSIZE=${HADOOP_HEAPSIZE:-$CLIENT_HEAPSIZE}

    Thanks,
    Roman.

Related Discussions

Discussion Navigation
viewthread | post

2 users in discussion

Koert: 2 posts Roman Shaposhnik: 1 post