FAQ
Hi all,

As per:
https://issues.apache.org/jira/browse/HIVE-2379

I added the following to the hive-site.xml safety valve in CM then deployed
the file to clients (plus restarted hive services):

<property>
<name>hive.aux.jars.path</name>
<description>Specify paths to jars for hbase integration - must update each
CDH release!</description>
<value>file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hive-hbase-handler-0.10.0-cdh4.2.0.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hbase.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/zookeeper.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/guava-11.0.2.jar
</value>
</property>

When trying to run a query that requires a map reduce job though I get this
error:

Job Submission failed with exception 'java.io.FileNotFoundException(File
file:/opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/guava-11.0.2.jar
does not exist)'

The file does indeed exist on the host however... I've also tried it
without the file:// handler ...

The hive-site.xml file does have it included merged from the valve as the
following:

</property>
<property>
<name>hive.aux.jars.path</name>

<value>file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hive-hbase-handler-0.10.0-cdh4.2.0.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hbase.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/zookeeper.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/guava-11.0.2.jar
</value> </property>

Hive does work as expected if I include this as hive --auxpath
/opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hive-hbase
-handler-0.10.0-cdh4.2.0.jar,/opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.
p0.10/lib/hive/lib/hbase.jar,/opt/cloudera/parcels/CDH-4.2.
0-1.cdh4.2.0.p0.10/lib/hive/lib/zookeeper.jar,/opt/
cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/guava-11.0.2.jar
and no reference to it in the site xml...

Any ideas?

Cheers,

James

Search Discussions

  • Philip Langdale at Apr 10, 2013 at 10:43 pm
    Hi James,

    Have you tried putting the file list as HIVE_AUX_JARS_PATH=<blah blah blah>
    in the hive-env.sh environment safety valve?
    Try that - not sure if you should use file:// or not, but try both.

    --phil

    On 10 April 2013 05:17, James Hogarth wrote:

    Hi all,

    As per:
    https://issues.apache.org/jira/browse/HIVE-2379

    I added the following to the hive-site.xml safety valve in CM then
    deployed the file to clients (plus restarted hive services):

    <property>
    <name>hive.aux.jars.path</name>
    <description>Specify paths to jars for hbase integration - must update
    each CDH release!</description>

    <value>file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hive-hbase-handler-0.10.0-cdh4.2.0.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hbase.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/zookeeper.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/guava-11.0.2.jar
    </value>
    </property>

    When trying to run a query that requires a map reduce job though I get
    this error:

    Job Submission failed with exception 'java.io.FileNotFoundException(File
    file:/opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/guava-11.0.2.jar
    does not exist)'

    The file does indeed exist on the host however... I've also tried it
    without the file:// handler ...

    The hive-site.xml file does have it included merged from the valve as the
    following:

    </property>
    <property>
    <name>hive.aux.jars.path</name>

    <value>file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hive-hbase-handler-0.10.0-cdh4.2.0.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/hbase.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/zookeeper.jar,file:///opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hive/lib/guava-11.0.2.jar
    </value> </property>

    Hive does work as expected if I include this as hive --auxpath
    /opt/cloudera/parcels/CDH-4.2.**0-1.cdh4.2.0.p0.10/lib/hive/**lib/hive-
    hbase-handler-0.10.0-**cdh4.2.0.jar,/opt/cloudera/**
    parcels/CDH-4.2.0-1.cdh4.2.0.**p0.10/lib/hive/lib/hbase.jar,/**
    opt/cloudera/parcels/CDH-4.2.**0-1.cdh4.2.0.p0.10/lib/hive/**
    lib/zookeeper.jar,/opt/**cloudera/parcels/CDH-4.2.0-1.**
    cdh4.2.0.p0.10/lib/hive/lib/**guava-11.0.2.jar and no reference to it in
    the site xml...

    Any ideas?

    Cheers,

    James


Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedApr 10, '13 at 12:17p
activeApr 10, '13 at 10:43p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

James Hogarth: 1 post Philip Langdale: 1 post

People

Translate

site design / logo © 2022 Grokbase