FAQ
In Beeswax, have you set as a 'Setting' something like this?

hbase.zookeeper.quorum localhost


https://github.com/romainr/hadoop-tutorials-examples/blob/master/hbase-hive-pig/create_hbase_table.sql#L4


We have a blog post almost ready about this.

Romain

On Wed, Sep 4, 2013 at 1:42 AM, Nicolas Maillard wrote:

Hello everyone

I am using HUE a one of my main hadoop interactions point but every so
often it is cryptic to understand what I am doing wrong.
My current issue is getting the HbasestorageHandler to work.

I have run a simple create external table in hive shell and is fine.
CREATE TABLE hbase_stocks(key INT, price FLOAT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" == ":key,stock:price")
TBLPROPERTIES ("hbase.table.name" = "stocks");


However the same in the HUE hive shell will result in an error to be more
precise a zookeeper connection error. I pretty sure the error is on my
side, do I need to reference hbase-site.xml file or jars in the HUe
interface?
the errior:


13/09/04 01:35:36 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
13/09/04 01:35:36 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
13/09/04 01:35:36 INFO exec.HiveHistory: Hive history file=/tmp/hue/hive_job_log_5d5a20eb-10bf-4e3d-b4ab-c5c457f7d221_216797580.txt
13/09/04 01:35:36 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
13/09/04 01:35:36 INFO ql.Driver: <PERFLOG method=Driver.run>
13/09/04 01:35:36 INFO ql.Driver: <PERFLOG method=TimeToSubmit>
13/09/04 01:35:36 INFO ql.Driver: <PERFLOG method=compile>
13/09/04 01:35:36 INFO parse.ParseDriver: Parsing command: use default
13/09/04 01:35:36 INFO parse.ParseDriver: Parse Completed
13/09/04 01:35:36 INFO ql.Driver: Semantic Analysis Completed
13/09/04 01:35:36 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
13/09/04 01:35:36 INFO ql.Driver: </PERFLOG method=compile start=1378283736294 end=1378283736294 duration=0>
13/09/04 01:35:36 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=zookeeperhost:2181 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@1342e4a
13/09/04 01:35:36 INFO ql.Driver: <PERFLOG method=acquireReadWriteLocks>
13/09/04 01:35:36 INFO ql.Driver: </PERFLOG method=acquireReadWriteLocks start=1378283736676 end=1378283736676 duration=0>
13/09/04 01:35:36 INFO ql.Driver: <PERFLOG method=Driver.execute>
13/09/04 01:35:36 INFO ql.Driver: Starting command: use default
13/09/04 01:35:36 INFO ql.Driver: </PERFLOG method=TimeToSubmit start=1378283736294 end=1378283736677 duration=383>
13/09/04 01:35:36 INFO ql.Driver: </PERFLOG method=Driver.execute start=1378283736676 end=1378283736684 duration=8>
OK
13/09/04 01:35:36 INFO ql.Driver: OK
13/09/04 01:35:36 INFO ql.Driver: <PERFLOG method=releaseLocks>
13/09/04 01:35:36 INFO ql.Driver: </PERFLOG method=releaseLocks start=1378283736684 end=1378283736684 duration=0>
13/09/04 01:35:36 INFO ql.Driver: </PERFLOG method=Driver.run start=1378283736293 end=1378283736684 duration=391>
13/09/04 01:35:36 INFO ql.Driver: <PERFLOG method=compile>
13/09/04 01:35:36 INFO parse.ParseDriver: Parsing command: CREATE TABLE hbase_stocks(key INT, name STRING, price FLOAT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,stock:name,stock:price")
TBLPROPERTIES ("hbase.table.name" = "stocks")
13/09/04 01:35:36 INFO parse.ParseDriver: Parse Completed
13/09/04 01:35:36 INFO parse.SemanticAnalyzer: Starting Semantic Analysis
13/09/04 01:35:36 INFO parse.SemanticAnalyzer: Creating table hbase_stocks position=13
13/09/04 01:35:36 INFO ql.Driver: Semantic Analysis Completed
13/09/04 01:35:36 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
13/09/04 01:35:36 INFO ql.Driver: </PERFLOG method=compile start=1378283736684 end=1378283736687 duration=3>
Hive history file=/tmp/hue/hive_job_log_5d5a20eb-10bf-4e3d-b4ab-c5c457f7d221_666904144.txt
13/09/04 01:35:36 INFO exec.HiveHistory: Hive history file=/tmp/hue/hive_job_log_5d5a20eb-10bf-4e3d-b4ab-c5c457f7d221_666904144.txt
13/09/04 01:35:36 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
13/09/04 01:35:36 INFO ql.Driver: <PERFLOG method=Driver.execute>
13/09/04 01:35:36 INFO ql.Driver: Starting command: CREATE TABLE hbase_stocks(key INT, name STRING, price FLOAT)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,stock:name,stock:price")
TBLPROPERTIES ("hbase.table.name" = "stocks")
13/09/04 01:35:36 INFO ql.Driver: </PERFLOG method=TimeToSubmit end=1378283736718>
13/09/04 01:35:36 INFO exec.DDLTask: Use StorageHandler-supplied org.apache.hadoop.hive.hbase.HBaseSerDe for table hbase_stocks
13/09/04 01:35:36 INFO hive.metastore: Trying to connect to metastore with URI thrift://hbasemaster:9083
13/09/04 01:35:36 INFO hive.metastore: Waiting 1 seconds before next connection attempt.
13/09/04 01:35:37 WARN conf.Configuration: fs.default.name is deprecated. Instead, use fs.defaultFS
13/09/04 01:35:37 WARN conf.Configuration: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
13/09/04 01:35:37 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
13/09/04 01:35:37 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 13726@myhost
13/09/04 01:35:37 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
13/09/04 01:35:37 INFO util.RetryCounter: Sleeping 2000ms before retry #1...
13/09/04 01:35:40 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
13/09/04 01:35:40 INFO util.RetryCounter: Sleeping 4000ms before retry #2...
13/09/04 01:35:44 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
13/09/04 01:35:44 INFO util.RetryCounter: Sleeping 8000ms before retry #3...
13/09/04 01:35:53 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
13/09/04 01:35:53 ERROR zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 3 retries
13/09/04 01:35:53 WARN zookeeper.ZKUtil: hconnection Unable to set watcher on znode (/hbase/hbaseid)
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:172)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:450)
at org.apache.hadoop.hbase.zookeeper.ClusterId.readClusterIdZNode(ClusterId.java:61)
at org.apache.hadoop.hbase.zookeeper.ClusterId.getId(ClusterId.java:50)
at org.apache.hadoop.hbase.zookeeper.ClusterId.hasId(ClusterId.java:44)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.ensureZookeeperTrackers(HConnectionManager.java:615)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:684)
at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:126)
at org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:73)
at org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:147)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:428)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:74)
at $Proxy16.createTable(Unknown Source)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:575)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3703)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:254)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:138)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1374)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1160)
at com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState.execute(BeeswaxServiceImpl.java:344)
at com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:609)
at com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:598)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:337)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1388)
at com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1.run(BeeswaxServiceImpl.java:598)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
13/09/04 01:35:53 ERROR zookeeper.ZooKeeperWatcher: hconnection Received unexpected KeeperException, re-throwing exception
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)

--

---
You received this message because you are subscribed to the Google Groups
"CDH Users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to cdh-user+unsubscribe@cloudera.org.
For more options, visit
https://groups.google.com/a/cloudera.org/groups/opt_out.
To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+unsubscribe@cloudera.org.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphue-user @
categorieshadoop
postedSep 4, '13 at 9:16p
activeSep 4, '13 at 9:16p
posts1
users1
websitecloudera.com
irc#hadoop

1 user in discussion

Romain Rigaux: 1 post

People

Translate

site design / logo © 2022 Grokbase