Grokbase Groups Hive user May 2011
FAQ
Hello,

I have a hadoop cluster running with the hadoop_append-jar (hadoop-core-0.20-append-r1056497-core.jar) for hbase reason.
I tried hive 0.6.0 and 0.7.0 and for both each when I start it I get
Exception in thread "main" java.lang.RuntimeException: Could not load shims in class null
at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:90)
at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:66)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:249)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.lang.NullPointerException
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:169)
at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:87)

My hive-site.xml:
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hive.metastore.warehouse.dir</name>
<value>hdfs://name-node:54310/hive</value>
<description>location of default database for the warehouse</description>
</property>
</configuration>

My hadoop cluster is working properly, the hive dir is already created.
Any clues?

labtrax


--
NEU: FreePhone - kostenlos mobil telefonieren und surfen!
Jetzt informieren: http://www.gmx.net/de/go/freephone

Search Discussions

  • Labtrax at May 9, 2011 at 6:17 pm
    Hello,

    it seems that hive 0.6 an 0.7 is incompatible with the hadoop-append-jar from hbase 0.90.2. But without the append-jar you cannot use hbase in production... Any advices for the hadoop/hbase/hive-version-jungle? I already ask this last month but I didn't get a reasonable answer.

    Cheers
    labtrax


    Hello,

    I have a hadoop cluster running with the hadoop_append-jar (hadoop-core-0.20-append-r1056497-core.jar)
    for hbase reason.
    I tried hive 0.6.0 and 0.7.0 and for both each when I start it I get
    Exception in thread "main" java.lang.RuntimeException: Could not load shims in class null
    at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:90)
    at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:66)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:249)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
    Caused by: java.lang.NullPointerException
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:169)
    at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:87)

    My hive-site.xml:
    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
    <configuration>
    <property>
    <name>hive.metastore.warehouse.dir</name>
    <value>hdfs://name-node:54310/hive</value>
    <description>location of default database for the warehouse</description>
    </property>
    </configuration>

    My hadoop cluster is working properly, the hive dir is already created.
    Any clues?

    labtrax


    --
    NEU: FreePhone - kostenlos mobil telefonieren und surfen!
    Jetzt informieren: http://www.gmx.net/de/go/freephone
  • John Sichi at May 9, 2011 at 7:11 pm
    Try one of these suggestions:

    (1) run HBase and Hive in separate clusters (downside is that map/reduce tasks will have to issue remote request to region servers whereas normally they could run on the same nodes)

    (2) debug the shim exception and see if you can contribute a patch that makes Hive compatible with that Hadoop version

    JVS
    On May 9, 2011, at 11:17 AM, labtrax wrote:

    Hello,

    it seems that hive 0.6 an 0.7 is incompatible with the hadoop-append-jar from hbase 0.90.2. But without the append-jar you cannot use hbase in production... Any advices for the hadoop/hbase/hive-version-jungle? I already ask this last month but I didn't get a reasonable answer.

    Cheers
    labtrax


    Hello,

    I have a hadoop cluster running with the hadoop_append-jar (hadoop-core-0.20-append-r1056497-core.jar)
    for hbase reason.
    I tried hive 0.6.0 and 0.7.0 and for both each when I start it I get
    Exception in thread "main" java.lang.RuntimeException: Could not load shims in class null
    at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:90)
    at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:66)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:249)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
    Caused by: java.lang.NullPointerException
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:169)
    at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:87)

    My hive-site.xml:
    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
    <configuration>
    <property>
    <name>hive.metastore.warehouse.dir</name>
    <value>hdfs://name-node:54310/hive</value>
    <description>location of default database for the warehouse</description>
    </property>
    </configuration>

    My hadoop cluster is working properly, the hive dir is already created.
    Any clues?

    labtrax


    --
    NEU: FreePhone - kostenlos mobil telefonieren und surfen!
    Jetzt informieren: http://www.gmx.net/de/go/freephone

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedMay 9, '11 at 2:14p
activeMay 9, '11 at 7:11p
posts3
users2
websitehive.apache.org

2 users in discussion

Labtrax: 2 posts John Sichi: 1 post

People

Translate

site design / logo © 2022 Grokbase