FAQ
Hi there,

we had a cluster with 6 nodes(41,42,43,44,45,46) in it one is name node(42)
and other 5 are data nodes. on one data node (41) we installed HIVE
completely no other service is installed on it. I want to use IMPALA now on
HIVE tables. on namenode(42) and other 4 datanodes(43,44,45,46) IMPALA
service is there but there is no SERVICE on HIVE data node(41) due to that
i am able to see the databases of HIVE that i created but i am unable to
see the tables what are containing in those databases. when typing the
command "Show Tables" from IMPALA shell it is throwing an error as
mentioned below. can anyone suggest what to do.


(Build version: Impala v0.6 (720f93c) built on Sat Feb 23 18:52:43 PST 2013)
[Not connected] > connect localhost
Connected to localhost:21000
[localhost:21000] > show databases;
Query: show databases
Query finished, fetching results ...
bcllf
default
Returned 4 row(s) in 0.01s
[localhost:21000] > use default;
Query: use default
Query finished, fetching results ...

Returned 0 row(s) in 0.00s
[localhost:21000] > show tables;
Query: show tables
ERROR: com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.IllegalStateException: MetaException(message:Got exception:
org.apache.thrift.transport.TTransportException java.net.SocketException:
Broken pipe)
         at
com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2234)
         at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
         at
com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3969)
         at
com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4829)
         at
com.cloudera.impala.catalog.Catalog$LazyDbMap.get(Catalog.java:132)
         at com.cloudera.impala.catalog.Catalog.getDb(Catalog.java:269)
         at
com.cloudera.impala.catalog.Catalog.getTableNames(Catalog.java:287)
         at
com.cloudera.impala.service.Frontend.getTableNames(Frontend.java:161)
         at
com.cloudera.impala.service.JniFrontend.getTableNames(JniFrontend.java:136)
Caused by: java.lang.IllegalStateException: MetaException(message:Got
exception: org.apache.thrift.transport.TTransportException
java.net.SocketException: Broken pipe)
         at com.cloudera.impala.catalog.Db.loadDb(Db.java:240)
         at
com.cloudera.impala.catalog.Catalog$LazyDbMap.loadDb(Catalog.java:163)
         at
com.cloudera.impala.catalog.Catalog$LazyDbMap.access$000(Catalog.java:87)
         at
com.cloudera.impala.catalog.Catalog$LazyDbMap$1.load(Catalog.java:93)
         at
com.cloudera.impala.catalog.Catalog$LazyDbMap$1.load(Catalog.java:91)
         at
com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3568)
         at
com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2350)
         at
com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2313)
         at
com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
         ... 8 more
Caused by: MetaException(message:Got exception:
org.apache.thrift.transport.TTransportException java.net.SocketException:
Broken pipe)
         at
org.apache.hadoop.hive.metastore.MetaStoreUtils.logAndThrowMetaException(MetaStoreUtils.java:833)
         at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getAllTables(HiveMetaStoreClient.java:829)
         at com.cloudera.impala.catalog.Db.(Db.java:230)
         ... 16 more

thanks for the help

Search Discussions

  • Darren Lo at Jun 6, 2013 at 3:33 pm
    It sounds like you have the following set up on each host:
    41: DataNode, Hive Metastore Server (assuming this is what you meant by
    HIVE is installed on this host)
    42: NameNode, ImpalaD
    43 - 46: DataNode, ImpalaD

    Unknown:
    * Location of Impala StateStore
    * Which hosts have Hive Gateway roles
    * CM Version
    * CDH Version
    * Impala Version

    If the above is correct, then you have a configuration problem. Impala
    requires that there is an ImpalaD on every host that has a DataNode, and no
    other hoses. This means you need add ImpalaD to host 41 and either add a
    DataNode to host 42 or remove the ImplaD from host 42.

    If not already done, add a Hive Gateway to each of your hosts, then run the
    Deploy Client Configuration command by using the Actions dropdown menu at
    the cluster-level. Try out all of your commands from Hive CLI ("hive" on
    command-line) to make sure that is working, then try again with Impala.

    Thanks,
    Darren

    On Thu, Jun 6, 2013 at 12:24 AM, someone wrote:

    Hi there,

    we had a cluster with 6 nodes(41,42,43,44,45,46) in it one is name
    node(42) and other 5 are data nodes. on one data node (41) we installed
    HIVE completely no other service is installed on it. I want to use IMPALA
    now on HIVE tables. on namenode(42) and other 4 datanodes(43,44,45,46)
    IMPALA service is there but there is no SERVICE on HIVE data node(41) due
    to that i am able to see the databases of HIVE that i created but i am
    unable to see the tables what are containing in those databases. when
    typing the command "Show Tables" from IMPALA shell it is throwing an error
    as mentioned below. can anyone suggest what to do.


    (Build version: Impala v0.6 (720f93c) built on Sat Feb 23 18:52:43 PST
    2013)
    [Not connected] > connect localhost
    Connected to localhost:21000
    [localhost:21000] > show databases;
    Query: show databases
    Query finished, fetching results ...
    bcllf
    default
    Returned 4 row(s) in 0.01s
    [localhost:21000] > use default;
    Query: use default
    Query finished, fetching results ...

    Returned 0 row(s) in 0.00s
    [localhost:21000] > show tables;
    Query: show tables
    ERROR: com.google.common.util.concurrent.UncheckedExecutionException:
    java.lang.IllegalStateException: MetaException(message:Got exception:
    org.apache.thrift.transport.TTransportException java.net.SocketException:
    Broken pipe)
    at
    com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2234)
    at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
    at
    com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3969)
    at
    com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4829)
    at
    com.cloudera.impala.catalog.Catalog$LazyDbMap.get(Catalog.java:132)
    at com.cloudera.impala.catalog.Catalog.getDb(Catalog.java:269)
    at
    com.cloudera.impala.catalog.Catalog.getTableNames(Catalog.java:287)
    at
    com.cloudera.impala.service.Frontend.getTableNames(Frontend.java:161)
    at
    com.cloudera.impala.service.JniFrontend.getTableNames(JniFrontend.java:136)
    Caused by: java.lang.IllegalStateException: MetaException(message:Got
    exception: org.apache.thrift.transport.TTransportException
    java.net.SocketException: Broken pipe)
    at com.cloudera.impala.catalog.Db.loadDb(Db.java:240)
    at
    com.cloudera.impala.catalog.Catalog$LazyDbMap.loadDb(Catalog.java:163)
    at
    com.cloudera.impala.catalog.Catalog$LazyDbMap.access$000(Catalog.java:87)
    at
    com.cloudera.impala.catalog.Catalog$LazyDbMap$1.load(Catalog.java:93)
    at
    com.cloudera.impala.catalog.Catalog$LazyDbMap$1.load(Catalog.java:91)
    at
    com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3568)
    at
    com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2350)
    at
    com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2313)
    at
    com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
    ... 8 more
    Caused by: MetaException(message:Got exception:
    org.apache.thrift.transport.TTransportException java.net.SocketException:
    Broken pipe)
    at
    org.apache.hadoop.hive.metastore.MetaStoreUtils.logAndThrowMetaException(MetaStoreUtils.java:833)
    at
    org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getAllTables(HiveMetaStoreClient.java:829)
    at com.cloudera.impala.catalog.Db.<init>(Db.java:207)
    at com.cloudera.impala.catalog.Db.loadDb(Db.java:230)
    ... 16 more

    thanks for the help


    --
    Thanks,
    Darren

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedJun 6, '13 at 7:24a
activeJun 6, '13 at 3:33p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Darren Lo: 1 post Someone: 1 post

People

Translate

site design / logo © 2022 Grokbase