Grokbase › Groups › Hadoop › impala-user › January 2013
FAQ
Hi,

I have created some hive tables and my impala service was running.

I can run query in hive and see table data as well.

But when i try to run the same query on my impala shell, I get error saying

Caused by: com.cloudera.impala.common.AnalysisException: Unknown table:

Do I need to restart impala service so that it can read hive metastore
again? I read that impala uses hive's metastore to get hive's data. So is
it reading hive's metadata during startup? Am I missing something here?

Thanks.
-Dipesh

Search Discussions

  • Henry Robinson at Jan 25, 2013 at 11:43 pm ⇧

    On 25 January 2013 15:39, Deepsoft wrote:

    Hi,

    I have created some hive tables and my impala service was running.

    I can run query in hive and see table data as well.

    But when i try to run the same query on my impala shell, I get error
    saying

    Caused by: com.cloudera.impala.common.AnalysisException: Unknown table:

    Do I need to restart impala service so that it can read hive metastore
    again? I read that impala uses hive's metastore to get hive's data. So is
    it reading hive's metadata during startup? Am I missing something here?

    Thanks.
    -Dipesh
    Hi -

    You need to use the 'refresh' command to update the metadata if it changes.

    From the shell, just type 'refresh'. Then you should be able to see your
    table.

    Henry

    --
    Henry Robinson
    Software Engineer
    Cloudera
    415-994-6679

    --
  • Deepsoft at Jan 26, 2013 at 12:03 am ⇧
    Henry,

    Thanks for the prompt reply. Now I'm able to see hive data instantly.

    Thanks.
    -Dipesh
    On Friday, January 25, 2013 3:43:26 PM UTC-8, Henry wrote:

    On 25 January 2013 15:39, Deepsoft <[email protected] <javascript:>>wrote:
    Hi,

    I have created some hive tables and my impala service was running.

    I can run query in hive and see table data as well.

    But when i try to run the same query on my impala shell, I get error
    saying

    Caused by: com.cloudera.impala.common.AnalysisException: Unknown table:

    Do I need to restart impala service so that it can read hive metastore
    again? I read that impala uses hive's metastore to get hive's data. So is
    it reading hive's metadata during startup? Am I missing something here?

    Thanks.
    -Dipesh
    Hi -

    You need to use the 'refresh' command to update the metadata if it changes.

    From the shell, just type 'refresh'. Then you should be able to see your
    table.

    Henry

    --
    Henry Robinson
    Software Engineer
    Cloudera
    415-994-6679
    --
  • Serega Sheypak at May 13, 2013 at 9:24 am ⇧
    Hi, I got pretty the same question.
    Here is console output:
    [node05.lol.ru:21000] > connect localhost:21000;
    Connected to localhost:21000
    Server version: impalad version 1.0 RELEASE (build
    d1bf0d1dac339af3692ffa17a5e3fdae0aed751f)
    *[localhost:21000] > show tables;*
    Query: show tables
    *ERROR: UncheckedExecutionException: java.lang.IllegalStateException:
    MetaException(message:Got exception:
    org.apache.thrift.transport.TTransportException null)*
    *CAUSED BY: IllegalStateException: MetaException(message:Got exception:
    org.apache.thrift.transport.TTransportException null)*
    *CAUSED BY: MetaException: Got exception:
    org.apache.thrift.transport.TTransportException null*
    *[localhost:21000] > refresh;*
    *Successfully refreshed catalog*
    [localhost:21000] > show tables;
    Query: show tables
    Query finished, fetching results ...
    +-------------+
    name |
    +-------------+
    impala_test |
    xvlr |
    +-------------+
    Returned 2 row(s) in 0.05s

    So I do see tables using impala-shell.
    I try to execute the same *show tables;* from HUE UI, but I get only one
    table as a response.
    How Can I force it to refresh metadata and see all tables?



    суббота, 26 января 2013 г., 4:03:13 UTC+4 пользователь Deepsoft написал:
    Henry,

    Thanks for the prompt reply. Now I'm able to see hive data instantly.

    Thanks.
    -Dipesh
    On Friday, January 25, 2013 3:43:26 PM UTC-8, Henry wrote:
    On 25 January 2013 15:39, Deepsoft wrote:

    Hi,

    I have created some hive tables and my impala service was running.

    I can run query in hive and see table data as well.

    But when i try to run the same query on my impala shell, I get error
    saying

    Caused by: com.cloudera.impala.common.AnalysisException: Unknown table:

    Do I need to restart impala service so that it can read hive metastore
    again? I read that impala uses hive's metastore to get hive's data. So is
    it reading hive's metadata during startup? Am I missing something here?

    Thanks.
    -Dipesh
    Hi -

    You need to use the 'refresh' command to update the metadata if it
    changes.

    From the shell, just type 'refresh'. Then you should be able to see your
    table.

    Henry

    --
    Henry Robinson
    Software Engineer
    Cloudera
    415-994-6679
  • Serega Sheypak at May 13, 2013 at 10:14 am ⇧
    Impala service restart helps to see all tables through hue.
    Is there any way to force hue UI to see metastore tables?

    понедельник, 13 мая 2013 г., 13:24:49 UTC+4 пользователь Serega Sheypak
    написал:
    Hi, I got pretty the same question.
    Here is console output:
    [node05.lol.ru:21000] > connect localhost:21000;
    Connected to localhost:21000
    Server version: impalad version 1.0 RELEASE (build
    d1bf0d1dac339af3692ffa17a5e3fdae0aed751f)
    *[localhost:21000] > show tables;*
    Query: show tables
    *ERROR: UncheckedExecutionException: java.lang.IllegalStateException:
    MetaException(message:Got exception:
    org.apache.thrift.transport.TTransportException null)*
    *CAUSED BY: IllegalStateException: MetaException(message:Got exception:
    org.apache.thrift.transport.TTransportException null)*
    *CAUSED BY: MetaException: Got exception:
    org.apache.thrift.transport.TTransportException null*
    *[localhost:21000] > refresh;*
    *Successfully refreshed catalog*
    [localhost:21000] > show tables;
    Query: show tables
    Query finished, fetching results ...
    +-------------+
    name |
    +-------------+
    impala_test |
    xvlr |
    +-------------+
    Returned 2 row(s) in 0.05s

    So I do see tables using impala-shell.
    I try to execute the same *show tables;* from HUE UI, but I get only one
    table as a response.
    How Can I force it to refresh metadata and see all tables?



    суббота, 26 января 2013 г., 4:03:13 UTC+4 пользователь Deepsoft написал:
    Henry,

    Thanks for the prompt reply. Now I'm able to see hive data instantly.

    Thanks.
    -Dipesh
    On Friday, January 25, 2013 3:43:26 PM UTC-8, Henry wrote:
    On 25 January 2013 15:39, Deepsoft wrote:

    Hi,

    I have created some hive tables and my impala service was running.

    I can run query in hive and see table data as well.

    But when i try to run the same query on my impala shell, I get error
    saying

    Caused by: com.cloudera.impala.common.AnalysisException: Unknown table:

    Do I need to restart impala service so that it can read hive metastore
    again? I read that impala uses hive's metastore to get hive's data. So is
    it reading hive's metadata during startup? Am I missing something here?

    Thanks.
    -Dipesh
    Hi -

    You need to use the 'refresh' command to update the metadata if it
    changes.

    From the shell, just type 'refresh'. Then you should be able to see your
    table.

    Henry

    --
    Henry Robinson
    Software Engineer
    Cloudera
    415-994-6679
  • Lenni Kuff at May 13, 2013 at 4:21 pm ⇧
    Hi,
    The "refresh" command only applies to the node impala-shell is connected
    to. You will need to issue a "refresh" using impala-shell against the node
    Hue is configured to connect to in order to see the tables in the UI.

    Thanks,
    Lenni
    Software Engineer - Cloudera
    On Mon, May 13, 2013 at 3:14 AM, Serega Sheypak wrote:

    Impala service restart helps to see all tables through hue.
    Is there any way to force hue UI to see metastore tables?

    понедельник, 13 мая 2013 г., 13:24:49 UTC+4 пользователь Serega Sheypak
    написал:
    Hi, I got pretty the same question.
    Here is console output:
    [node05.lol.ru:21000] > connect localhost:21000;
    Connected to localhost:21000
    Server version: impalad version 1.0 RELEASE (build
    d1bf0d1dac339af3692ffa17a5e3fd**ae0aed751f)
    *[localhost:21000] > show tables;*
    Query: show tables
    *ERROR: UncheckedExecutionException: java.lang.IllegalStateException:
    MetaException(message:Got exception: org.apache.thrift.transport.TTransportException
    null)*
    *CAUSED BY: IllegalStateException: MetaException(message:Got exception:
    org.apache.thrift.transport.TTransportException null)*
    *CAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException
    null*
    *[localhost:21000] > refresh;*
    *Successfully refreshed catalog*
    [localhost:21000] > show tables;
    Query: show tables
    Query finished, fetching results ...
    +-------------+
    name |
    +-------------+
    impala_test |
    xvlr |
    +-------------+
    Returned 2 row(s) in 0.05s

    So I do see tables using impala-shell.
    I try to execute the same *show tables;* from HUE UI, but I get only one
    table as a response.
    How Can I force it to refresh metadata and see all tables?



    суббота, 26 января 2013 г., 4:03:13 UTC+4 пользователь Deepsoft написал:
    Henry,

    Thanks for the prompt reply. Now I'm able to see hive data instantly.

    Thanks.
    -Dipesh
    On Friday, January 25, 2013 3:43:26 PM UTC-8, Henry wrote:
    On 25 January 2013 15:39, Deepsoft wrote:

    Hi,

    I have created some hive tables and my impala service was running.

    I can run query in hive and see table data as well.

    But when i try to run the same query on my impala shell, I get error
    saying

    Caused by: com.cloudera.impala.common.**AnalysisException: Unknown
    table:

    Do I need to restart impala service so that it can read hive metastore
    again? I read that impala uses hive's metastore to get hive's data. So is
    it reading hive's metadata during startup? Am I missing something here?

    Thanks.
    -Dipesh
    Hi -

    You need to use the 'refresh' command to update the metadata if it
    changes.

    From the shell, just type 'refresh'. Then you should be able to see
    your table.

    Henry

    --
    Henry Robinson
    Software Engineer
    Cloudera
    415-994-6679
  • Serega Sheypak at May 13, 2013 at 5:07 pm ⇧
    Is there any possibility to automate it using cloudera manager
    13.05.2013 18:21 пользователь "Lenni Kuff" <[email protected]> написал:
    Hi,
    The "refresh" command only applies to the node impala-shell is connected
    to. You will need to issue a "refresh" using impala-shell against the node
    Hue is configured to connect to in order to see the tables in the UI.

    Thanks,
    Lenni
    Software Engineer - Cloudera
    On Mon, May 13, 2013 at 3:14 AM, Serega Sheypak wrote:

    Impala service restart helps to see all tables through hue.
    Is there any way to force hue UI to see metastore tables?

    понедельник, 13 мая 2013 г., 13:24:49 UTC+4 пользователь Serega Sheypak
    написал:
    Hi, I got pretty the same question.
    Here is console output:
    [node05.lol.ru:21000] > connect localhost:21000;
    Connected to localhost:21000
    Server version: impalad version 1.0 RELEASE (build
    d1bf0d1dac339af3692ffa17a5e3fd**ae0aed751f)
    *[localhost:21000] > show tables;*
    Query: show tables
    *ERROR: UncheckedExecutionException: java.lang.IllegalStateException:
    MetaException(message:Got exception: org.apache.thrift.transport.TTransportException
    null)*
    *CAUSED BY: IllegalStateException: MetaException(message:Got exception:
    org.apache.thrift.transport.TTransportException null)*
    *CAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException
    null*
    *[localhost:21000] > refresh;*
    *Successfully refreshed catalog*
    [localhost:21000] > show tables;
    Query: show tables
    Query finished, fetching results ...
    +-------------+
    name |
    +-------------+
    impala_test |
    xvlr |
    +-------------+
    Returned 2 row(s) in 0.05s

    So I do see tables using impala-shell.
    I try to execute the same *show tables;* from HUE UI, but I get only
    one table as a response.
    How Can I force it to refresh metadata and see all tables?



    суббота, 26 января 2013 г., 4:03:13 UTC+4 пользователь Deepsoft написал:
    Henry,

    Thanks for the prompt reply. Now I'm able to see hive data instantly.

    Thanks.
    -Dipesh
    On Friday, January 25, 2013 3:43:26 PM UTC-8, Henry wrote:
    On 25 January 2013 15:39, Deepsoft wrote:

    Hi,

    I have created some hive tables and my impala service was running.

    I can run query in hive and see table data as well.

    But when i try to run the same query on my impala shell, I get error
    saying

    Caused by: com.cloudera.impala.common.**AnalysisException: Unknown
    table:

    Do I need to restart impala service so that it can read hive
    metastore again? I read that impala uses hive's metastore to get hive's
    data. So is it reading hive's metadata during startup? Am I missing
    something here?

    Thanks.
    -Dipesh
    Hi -

    You need to use the 'refresh' command to update the metadata if it
    changes.

    From the shell, just type 'refresh'. Then you should be able to see
    your table.

    Henry

    --
    Henry Robinson
    Software Engineer
    Cloudera
    415-994-6679
  • Romain Rigaux at May 13, 2013 at 5:19 pm ⇧
    Hue has a 'Refresh Catalog' button since Hue 2.3 (released a month ago):
    https://issues.cloudera.org/browse/HUE-1100

    Hue 2.3 will be included in CDH4.3 which target date is early June.

    Romain


    On Mon, May 13, 2013 at 10:07 AM, Serega Sheypak
    wrote:
    Is there any possibility to automate it using cloudera manager
    13.05.2013 18:21 пользователь "Lenni Kuff" <[email protected]> написал:

    Hi,
    The "refresh" command only applies to the node impala-shell is connected
    to. You will need to issue a "refresh" using impala-shell against the node
    Hue is configured to connect to in order to see the tables in the UI.

    Thanks,
    Lenni
    Software Engineer - Cloudera

    On Mon, May 13, 2013 at 3:14 AM, Serega Sheypak <[email protected]
    wrote:
    Impala service restart helps to see all tables through hue.
    Is there any way to force hue UI to see metastore tables?

    понедельник, 13 мая 2013 г., 13:24:49 UTC+4 пользователь Serega Sheypak
    написал:
    Hi, I got pretty the same question.
    Here is console output:
    [node05.lol.ru:21000] > connect localhost:21000;
    Connected to localhost:21000
    Server version: impalad version 1.0 RELEASE (build
    d1bf0d1dac339af3692ffa17a5e3fd**ae0aed751f)
    *[localhost:21000] > show tables;*
    Query: show tables
    *ERROR: UncheckedExecutionException: java.lang.IllegalStateException:
    MetaException(message:Got exception: org.apache.thrift.transport.TTransportException
    null)*
    *CAUSED BY: IllegalStateException: MetaException(message:Got
    exception: org.apache.thrift.transport.TTransportException null)*
    *CAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException
    null*
    *[localhost:21000] > refresh;*
    *Successfully refreshed catalog*
    [localhost:21000] > show tables;
    Query: show tables
    Query finished, fetching results ...
    +-------------+
    name |
    +-------------+
    impala_test |
    xvlr |
    +-------------+
    Returned 2 row(s) in 0.05s

    So I do see tables using impala-shell.
    I try to execute the same *show tables;* from HUE UI, but I get only
    one table as a response.
    How Can I force it to refresh metadata and see all tables?



    суббота, 26 января 2013 г., 4:03:13 UTC+4 пользователь Deepsoft написал:
    Henry,

    Thanks for the prompt reply. Now I'm able to see hive data instantly.

    Thanks.
    -Dipesh
    On Friday, January 25, 2013 3:43:26 PM UTC-8, Henry wrote:
    On 25 January 2013 15:39, Deepsoft wrote:

    Hi,

    I have created some hive tables and my impala service was running.

    I can run query in hive and see table data as well.

    But when i try to run the same query on my impala shell, I get error
    saying

    Caused by: com.cloudera.impala.common.**AnalysisException: Unknown
    table:

    Do I need to restart impala service so that it can read hive
    metastore again? I read that impala uses hive's metastore to get hive's
    data. So is it reading hive's metadata during startup? Am I missing
    something here?

    Thanks.
    -Dipesh
    Hi -

    You need to use the 'refresh' command to update the metadata if it
    changes.

    From the shell, just type 'refresh'. Then you should be able to see
    your table.

    Henry

    --
    Henry Robinson
    Software Engineer
    Cloudera
    415-994-6679
  • Serega Sheypak at May 14, 2013 at 9:41 am ⇧
    Thanks, we'll wait.
    Rgiht now we do submit "create table" using HUE Impala UI. It helps.

    понедельник, 13 мая 2013 г., 21:19:07 UTC+4 пользователь Romain написал:
    Hue has a 'Refresh Catalog' button since Hue 2.3 (released a month ago):
    https://issues.cloudera.org/browse/HUE-1100

    Hue 2.3 will be included in CDH4.3 which target date is early June.

    Romain


    On Mon, May 13, 2013 at 10:07 AM, Serega Sheypak <[email protected]<javascript:>
    wrote:
    Is there any possibility to automate it using cloudera manager
    13.05.2013 18:21 пользователь "Lenni Kuff" <[email protected]<javascript:>>
    написал:

    Hi,
    The "refresh" command only applies to the node impala-shell is connected
    to. You will need to issue a "refresh" using impala-shell against the node
    Hue is configured to connect to in order to see the tables in the UI.

    Thanks,
    Lenni
    Software Engineer - Cloudera

    On Mon, May 13, 2013 at 3:14 AM, Serega Sheypak <[email protected]<javascript:>
    wrote:
    Impala service restart helps to see all tables through hue.
    Is there any way to force hue UI to see metastore tables?

    понедельник, 13 мая 2013 г., 13:24:49 UTC+4 пользователь Serega Sheypak
    написал:
    Hi, I got pretty the same question.
    Here is console output:
    [node05.lol.ru:21000] > connect localhost:21000;
    Connected to localhost:21000
    Server version: impalad version 1.0 RELEASE (build
    d1bf0d1dac339af3692ffa17a5e3fd**ae0aed751f)
    *[localhost:21000] > show tables;*
    Query: show tables
    *ERROR: UncheckedExecutionException: java.lang.IllegalStateException:
    MetaException(message:Got exception: org.apache.thrift.transport.TTransportException
    null)*
    *CAUSED BY: IllegalStateException: MetaException(message:Got
    exception: org.apache.thrift.transport.TTransportException null)*
    *CAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException
    null*
    *[localhost:21000] > refresh;*
    *Successfully refreshed catalog*
    [localhost:21000] > show tables;
    Query: show tables
    Query finished, fetching results ...
    +-------------+
    name |
    +-------------+
    impala_test |
    xvlr |
    +-------------+
    Returned 2 row(s) in 0.05s

    So I do see tables using impala-shell.
    I try to execute the same *show tables;* from HUE UI, but I get only
    one table as a response.
    How Can I force it to refresh metadata and see all tables?



    суббота, 26 января 2013 г., 4:03:13 UTC+4 пользователь Deepsoft
    написал:
    Henry,

    Thanks for the prompt reply. Now I'm able to see hive data instantly.

    Thanks.
    -Dipesh
    On Friday, January 25, 2013 3:43:26 PM UTC-8, Henry wrote:
    On 25 January 2013 15:39, Deepsoft wrote:

    Hi,

    I have created some hive tables and my impala service was running.

    I can run query in hive and see table data as well.

    But when i try to run the same query on my impala shell, I get
    error saying

    Caused by: com.cloudera.impala.common.**AnalysisException: Unknown
    table:

    Do I need to restart impala service so that it can read hive
    metastore again? I read that impala uses hive's metastore to get hive's
    data. So is it reading hive's metadata during startup? Am I missing
    something here?

    Thanks.
    -Dipesh
    Hi -

    You need to use the 'refresh' command to update the metadata if it
    changes.

    From the shell, just type 'refresh'. Then you should be able to see
    your table.

    Henry

    --
    Henry Robinson
    Software Engineer
    Cloudera
    415-994-6679

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupimpala-user @
categorieshadoop
postedJan 25, '13 at 11:39p
activeMay 14, '13 at 9:41a
posts9
users5
websitecloudera.com
irc#hadoop

5 users in discussion

Serega Sheypak: 4 posts Deepsoft: 2 posts Lenni Kuff: 1 post Henry Robinson: 1 post Romain Rigaux: 1 post

Content

People

Support

Translate

site design / logo © 2023 Grokbase