FAQ
I've installed CDH4 (not 4.1 yet) and I am trying to work with PIG to load
HBASE. I've not altered the configuration from the default install.


raw_data = LOAD 'sample_data.csv' USING PigStorage( ',' ) AS (
listing_id: chararray,
fname: chararray,
lname: chararray );
STORE raw_data INTO 'hbase://sample_names' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage (
'info:fname info:lname');

I can run this with PIG in local mode and it works fine.

When I run in mapreduce mode, it fails.

2012-10-31 09:50:22,345 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/filter/Filter

I've tried registering the HBASE jars like this:

register /usr/lib/hbase/hbase-0.92.1-cdh4.0.1-security.jar
register /usr/lib/zookeeper/zookeeper-3.4.3-cdh4.0.1.jar
register /usr/lib/hbase/lib/guava-11.0.2.jar

Same results.

What is left on the configuration that I am missing? CDH4 seems to handle
the configuration so automatically that I'm surprised this doesn't work.


Jim

Search Discussions

  • Jim Hendricks at Oct 31, 2012 at 2:55 pm
    To be more specific, it is CDH4.0.4
    On Wednesday, October 31, 2012 9:54:15 AM UTC-5, Jim Hendricks wrote:

    I've installed CDH4 (not 4.1 yet) and I am trying to work with PIG to load
    HBASE. I've not altered the configuration from the default install.


    raw_data = LOAD 'sample_data.csv' USING PigStorage( ',' ) AS (
    listing_id: chararray,
    fname: chararray,
    lname: chararray );
    STORE raw_data INTO 'hbase://sample_names' USING
    org.apache.pig.backend.hadoop.hbase.HBaseStorage (
    'info:fname info:lname');

    I can run this with PIG in local mode and it works fine.

    When I run in mapreduce mode, it fails.

    2012-10-31 09:50:22,345 [main] ERROR org.apache.pig.tools.grunt.Grunt -
    ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/filter/Filter

    I've tried registering the HBASE jars like this:

    register /usr/lib/hbase/hbase-0.92.1-cdh4.0.1-security.jar
    register /usr/lib/zookeeper/zookeeper-3.4.3-cdh4.0.1.jar
    register /usr/lib/hbase/lib/guava-11.0.2.jar

    Same results.

    What is left on the configuration that I am missing? CDH4 seems to handle
    the configuration so automatically that I'm surprised this doesn't work.


    Jim


  • Joey Echeverria at Nov 1, 2012 at 3:09 pm
    To be more specific, it is CDH4.0.4
    I think that's your problem The regiser commands you entered all have
    4.0.1 in their names. It might be easier to register the un-versioned
    names where available:

    register /usr/lib/hbase/hbase.jar
    register /usr/lib/zookeeper/zookeeper.jar
    register /usr/lib/hbase/lib/guava-11.0.2.jar

    -Joey
    On Wed, Oct 31, 2012 at 10:55 AM, Jim Hendricks wrote:
    To be more specific, it is CDH4.0.4
    On Wednesday, October 31, 2012 9:54:15 AM UTC-5, Jim Hendricks wrote:

    I've installed CDH4 (not 4.1 yet) and I am trying to work with PIG to load
    HBASE. I've not altered the configuration from the default install.


    raw_data = LOAD 'sample_data.csv' USING PigStorage( ',' ) AS (
    listing_id: chararray,
    fname: chararray,
    lname: chararray );
    STORE raw_data INTO 'hbase://sample_names' USING
    org.apache.pig.backend.hadoop.hbase.HBaseStorage (
    'info:fname info:lname');

    I can run this with PIG in local mode and it works fine.

    When I run in mapreduce mode, it fails.

    2012-10-31 09:50:22,345 [main] ERROR org.apache.pig.tools.grunt.Grunt -
    ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/filter/Filter

    I've tried registering the HBASE jars like this:

    register /usr/lib/hbase/hbase-0.92.1-cdh4.0.1-security.jar
    register /usr/lib/zookeeper/zookeeper-3.4.3-cdh4.0.1.jar
    register /usr/lib/hbase/lib/guava-11.0.2.jar

    Same results.

    What is left on the configuration that I am missing? CDH4 seems to handle
    the configuration so automatically that I'm surprised this doesn't work.


    Jim



    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedOct 31, '12 at 2:54p
activeNov 1, '12 at 3:09p
posts3
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Jim Hendricks: 2 posts Joey Echeverria: 1 post

People

Translate

site design / logo © 2022 Grokbase